-- Logs begin at Mon 2022-08-29 22:42:45 UTC, end at Mon 2022-08-29 23:40:03 UTC. -- Aug 29 23:08:06.742567 dv-cinder-854272-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:08:06 2022] *** Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: nodename: dv-cinder-854272-4-smb Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: machine: x86_64 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: clock source: unix Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: pcre jit disabled Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: detected number of CPU cores: 4 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: current working directory: / Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: your processes number limit is 47680 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: your memory page size is 4096 bytes Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: detected max file descriptor number: 2048 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: lock engine: pthread robust mutexes Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: thunder lock: enabled Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 23:08:06.754727 dv-cinder-854272-4-smb devstack@keystone.service[81451]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:08:06.794687 dv-cinder-854272-4-smb devstack@keystone.service[81451]: Python main interpreter initialized at 0x55977a0759c0 Aug 29 23:08:06.794687 dv-cinder-854272-4-smb devstack@keystone.service[81451]: python threads support enabled Aug 29 23:08:06.794687 dv-cinder-854272-4-smb devstack@keystone.service[81451]: your server socket listen backlog is limited to 100 connections Aug 29 23:08:06.794687 dv-cinder-854272-4-smb devstack@keystone.service[81451]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:08:06.795104 dv-cinder-854272-4-smb devstack@keystone.service[81451]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:08:06.795182 dv-cinder-854272-4-smb devstack@keystone.service[81451]: *** Operational MODE: preforking *** Aug 29 23:08:06.795413 dv-cinder-854272-4-smb devstack@keystone.service[81451]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:08:06.795413 dv-cinder-854272-4-smb devstack@keystone.service[81451]: spawned uWSGI master process (pid: 81451) Aug 29 23:08:06.795626 dv-cinder-854272-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 23:08:06.801323 dv-cinder-854272-4-smb devstack@keystone.service[81451]: spawned uWSGI worker 1 (pid: 81465, cores: 1) Aug 29 23:08:06.801323 dv-cinder-854272-4-smb devstack@keystone.service[81451]: spawned uWSGI worker 2 (pid: 81466, cores: 1) Aug 29 23:08:06.801323 dv-cinder-854272-4-smb devstack@keystone.service[81451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:08:11.181068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:08:11.181068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: from cryptography.utils import int_from_bytes Aug 29 23:08:11.181956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:08:11.181956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: from cryptography.utils import int_from_bytes Aug 29 23:08:11.221313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:08:11.221313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: from cryptography.utils import int_from_bytes Aug 29 23:08:11.221859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:08:11.221859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: from cryptography.utils import int_from_bytes Aug 29 23:08:11.231525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:08:11.231723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:08:11.231919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] command line args: [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:08:11.232194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:08:11.232374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ================================================================================ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:08:11.232630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] admin_token = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.232876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_dir = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.233065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.233270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_source = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.233451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] debug = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.233649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_config_append = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_dir = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.235778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.236030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.236279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.236528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.236707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.236886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.237142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.237393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.237629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.237862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.238094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.238326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.238572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.238819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.239094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.239589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.239771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] publish_errors = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.240002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.240231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.240409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.240653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.240888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.241141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] standard_threads = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.241378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.241622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.241799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.241975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_journal = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.242151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_json = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.242325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_stderr = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.242500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_syslog = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.242730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.242984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.243223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.243483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.243722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.243969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.244205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.244507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.244784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.245035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.245306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.245558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.245795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.246041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.246278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.246527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.246774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.247011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.247265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.247516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.247762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.247998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.248251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.248512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.248767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.249017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.249277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.249509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.249741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.249977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.250227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.250483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.250701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.250930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.251177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.251425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.251696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.251949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.252181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.252416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.252651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.252880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.253128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.253360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.253589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.253825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.254071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.254300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.254536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.254764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.255000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.255234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.255482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.255711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.255948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.256182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.256416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.256651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.256885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.257132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.257380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.257615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.257851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.258083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.258342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.258577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.258807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.259042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.259284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.259551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.259788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.260537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.260889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.261149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.261390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.261627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.261876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.262115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.262353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.262596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.262832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.263080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.263317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.263552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.263787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.264022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.264257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.264521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.264765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.265011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.265277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.265519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.265760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.265997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.266233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.266467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.266698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.266929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.267161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.267395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.267627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.267867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.268106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.268355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.268591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.268848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.269129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.269370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.269604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.external = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.269840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.270139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.270260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:08:11.270375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.270454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:08:11.270606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.password = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.270736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] command line args: [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:08:11.270837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.token = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.270924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:08:11.271073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ================================================================================ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:08:11.271150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.271308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.271386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] admin_token = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.271555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.271641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config_dir = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.271745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.271822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.271932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config_source = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.272009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.272117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] debug = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.272255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.272339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.272489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.272573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.272971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.273159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.273237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.273312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.273480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.273563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.273719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.273803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.273903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_config_append = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.273987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.274082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.274190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.274267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_dir = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.274425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.274509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.274661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.274744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.274913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.274991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.275150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.275235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.275402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.275486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.275585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.275781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.276430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.276568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.276775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.276918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.277058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.277208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.277316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.277396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.277506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.277623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.277722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.277826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.277957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.278066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.278204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.278316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.278437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.278551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.278685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.278767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.278921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.279176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.279262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.279414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.279538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] publish_errors = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.279649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.279728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.279884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.279974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.280068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.280147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.280317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.280399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.280554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.280644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.280790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] standard_threads = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.280872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.281025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.281103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.281298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.281465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.281548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.281625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_journal = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.281718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.281797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_json = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.281951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.282072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_stderr = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.282154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_syslog = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.282271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.282346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:08:11.282468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.282590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.282675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.282816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.282937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.283877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.284877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.285982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.286941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.287971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.288920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.289893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.290860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.291992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.292946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.293942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.294885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.295984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.296928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.297983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.298942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.299883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.300884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.301966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.302944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.303894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.304849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.305980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.306761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.307441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.307552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.307691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.307814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.307941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.308195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.308314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.308508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.308589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.308777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.308857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.external = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.309903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.password = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.token = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.310875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.311987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.312931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.313993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.314958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.315919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.316905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.317911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.318854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.319961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.320989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.321956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.322030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:08:11.322111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.322320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.322612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.323522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.323960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.324234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.324493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.324773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.325019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.325292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.325531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.325774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.326011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.326253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.326496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.326740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.326993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.327229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.327481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.327731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.327970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.328220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.328470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.328703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.328943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.329197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.329441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.329681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.329924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.330163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.330526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.330789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.331048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.331288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.331528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.331783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.332037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.332279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.332519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.332761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.332997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.333264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.333528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.333765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.334018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.334271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.334523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.334768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.335005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.335250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.335488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.335727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.335961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.336211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.336460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.336708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.336955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.337236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.337473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.337721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.337960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.338220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.338618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.338985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.339239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.339493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.339735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.339995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.340228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.340477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.340715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.340955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.341220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.341473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.341718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.341954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.342194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.342437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.342690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.342942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.343181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.343433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.343683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.343920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.344170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.344410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.344650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.344889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.345164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.345401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.345652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.345903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.346152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.346401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.346650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.346900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.347148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.347399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.347633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.347883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.348133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.348385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.348636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.349044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.349310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.349568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.349822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.350071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.350324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.350559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.350818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.351073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.351317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.351554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.351638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.351790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.351888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.352016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.352111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.352268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.352527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.352775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.353016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.353279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.353515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.353755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.354165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.354634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.354921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.355191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.355448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.355693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.355942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.356191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.356443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.356687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.356930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.357193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.357448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.357730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.357965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.358212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.358484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.358748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.358994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.359246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.359486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.359729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.359969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.360210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.360449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.360574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.360686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.360933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.361195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.361444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.361684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.361938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.362177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.362424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.362659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.362903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.363141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:08:11.363313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:08:11.389368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.389600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.389879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.390115 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.390340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.398989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.417798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.418035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.443034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.459862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.491910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.492145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.495961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.496194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.649994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.650225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.650452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.650699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.651079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.651279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.651675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.651937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.652170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.652398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.652621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.652840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.675920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.676002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.676134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.676216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.676348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.676430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.676560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.688349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.688580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.701595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.701729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.701798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.701858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.701994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.702951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:08:11.720028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.720238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:08:11.720341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.720452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:08:11.720584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.720787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:08:11.720869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.720987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:08:11.721078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.721293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.721378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.721559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.721640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.721822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.721905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.722084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.732184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.732417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.732500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.732701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.732784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.732976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.733061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.733289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.739908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.740259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.742797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.743087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.743170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.743372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.743459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.743660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.743757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.743947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.744036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.744211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.744295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.744552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.745203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.745357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.745597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.745682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.745894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.745974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.746163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.746254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.746443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.746719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.768724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.769776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.770200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.770485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.771249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.771535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.775250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.775537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.775943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.776675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.776964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.777396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.782413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.782704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.783767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.784057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.786628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.786924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.787207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.787490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.787768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.788025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.788320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.788609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.789004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.789375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.789659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.789739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.789937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.790030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.790229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.790318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.806789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.807144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.809135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.809413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.811500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.813285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.814625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.814925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.816379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.816790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.819256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.821014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.822403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.824475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.825536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.825838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.826126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.826415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.826699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.827081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.827597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.827902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.828197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.828607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.828895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.829220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.842856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.843138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.843412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.843680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.845418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.845709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.845979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.846259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.850401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.852045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.852962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.853615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.854483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.855511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.857049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.857251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.857337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.857538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.857831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.858115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.858414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.859985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.860281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.860569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.860865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.861178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.870249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.870541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.870828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.871112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.871403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.871681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.871978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.873300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.873592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.873880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.874167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.874451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.874730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.875018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.887418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.890441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.890707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.893351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.893748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.894783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.896256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.896542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.896624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.896837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.898329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.899805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.900094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.900391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.904228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.905743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.907265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.908577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.908739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.908877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.909201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.909491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.911638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.911935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.912226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.912506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.917901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.918193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.918474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.921419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.921726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.922012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.925359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.925648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.925931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.926206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.926478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.926756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.927032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.927308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.927585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.927870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.928142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.928404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.928668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.928869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:08:11.928997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.929186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.929471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.929751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.930028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.930315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.930600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.930870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.931157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.931431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.931703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.932022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.932987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.933406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:08:11.963562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55977a0759c0 pid: 81466 (default app) Aug 29 23:08:11.967387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924f9a-540b-4cb4-8431-fafe8093148a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:11.967680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924f9a-540b-4cb4-8431-fafe8093148a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:11.967953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924f9a-540b-4cb4-8431-fafe8093148a None None] PATH_INFO: `/v3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:11.968705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55977a0759c0 pid: 81465 (default app) Aug 29 23:08:11.972122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 791 bytes} [Mon Aug 29 23:08:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:18.656326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:18.656814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:18.656901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:18.661219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1/2] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:18.667411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:18.667969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:18.667969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:18.738710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: INFO dbcounter [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] Registered counter for database keystone Aug 29 23:08:18.758032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG oslo_db.sqlalchemy.engines [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:08:18.764401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writer thread running {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:08:18.956483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG passlib.handlers.bcrypt [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81466) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 23:08:18.956789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG passlib.handlers.bcrypt [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81466) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 23:08:19.015157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:19.016765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:19.147001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 2/3] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 23:08:19.598142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:19.668086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: INFO dbcounter [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] Registered counter for database keystone Aug 29 23:08:19.690553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:08:19.696959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writer thread running {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:08:19.818570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bb169-015d-4525-b35c-75c2a91a57b3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:19.823442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:19.824087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:19.824367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:19.824640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:19.832807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:19.883598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 23:08:19.883884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973f273-de42-4d99-9c20-0a3cf6806f4a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:19.894097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 2/4] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Aug 29 23:08:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:08:19.900361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:19.914828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140bf51-ed7e-4d2f-93b5-94a9dd455184 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:19.919726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:19.920810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:19.921089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:19.921453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] PATH_INFO: `/v3/projects/d0262c974ef34627ad89ce1c8f11f804` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:19.922998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] RBAC: Authorizing `identity:get_project(project_id=d0262c974ef34627ad89ce1c8f11f804)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:19.974426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 23:08:19.974763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701772c-0ed9-4dd7-b61c-cc5e57ed64bf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:19.980106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 3/5] 10.222.0.88 () {56 vars in 1207 bytes} [Mon Aug 29 23:08:19 2022] GET /identity/v3/projects/d0262c974ef34627ad89ce1c8f11f804 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:21.870644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67ecc9-032b-4c2e-b114-ab157f5e0380 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:21.871173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67ecc9-032b-4c2e-b114-ab157f5e0380 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:21.871173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67ecc9-032b-4c2e-b114-ab157f5e0380 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:21.875388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 3/6] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:21.880636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:21.881041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:21.881202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:21.901705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:21.903190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:21.910842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 4/7] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 23:08:22.181294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67ecc9-032b-4c2e-b114-ab157f5e0380 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:22.193399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67ecc9-032b-4c2e-b114-ab157f5e0380 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:22.198178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867f82-11ca-425a-9f8f-85c2c8b3e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:22.198832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867f82-11ca-425a-9f8f-85c2c8b3e314 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:22.199112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867f82-11ca-425a-9f8f-85c2c8b3e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:22.199388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867f82-11ca-425a-9f8f-85c2c8b3e314 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:22.206979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42867f82-11ca-425a-9f8f-85c2c8b3e314 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:22.208755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42867f82-11ca-425a-9f8f-85c2c8b3e314 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:22.218034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 4/8] 10.222.0.88 () {58 vars in 1324 bytes} [Mon Aug 29 23:08:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:08:22.223324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:22.232432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dacd24-4950-4a94-ac11-01c1711396f3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:22.236785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e563be8-96db-466d-a05e-8a16d5c3807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:22.237443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563be8-96db-466d-a05e-8a16d5c3807d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:22.237729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563be8-96db-466d-a05e-8a16d5c3807d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:22.238008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e563be8-96db-466d-a05e-8a16d5c3807d admin admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:22.239340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563be8-96db-466d-a05e-8a16d5c3807d admin admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:22.241196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e563be8-96db-466d-a05e-8a16d5c3807d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:22.242722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 5/9] 10.222.0.88 () {56 vars in 1198 bytes} [Mon Aug 29 23:08:22 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:24.203534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d84f3-2173-49bd-b05b-93b5c005962c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.204084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d84f3-2173-49bd-b05b-93b5c005962c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.204084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d84f3-2173-49bd-b05b-93b5c005962c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.205471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 5/10] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:24.210601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.211015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.211179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.223025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96276bb-7025-4a39-ac8e-b9b57bd6083e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.223309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96276bb-7025-4a39-ac8e-b9b57bd6083e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.223584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96276bb-7025-4a39-ac8e-b9b57bd6083e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.224885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 6/11] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:08:24.229907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.230192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.230299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:24.230472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.231517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:24.272300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG passlib.handlers.bcrypt [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81465) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 23:08:24.272685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG passlib.handlers.bcrypt [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81465) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 23:08:24.312811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 6/12] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:24.321879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:24.324077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:24.422590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 7/13] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:24.584506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:24.610983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:24.687209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:24.689247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902e1db-76d4-413e-96b7-e46440db59ee None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:24.723125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:24.723767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.724049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.724327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.736229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:24.745336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:24.746493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:24.747467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 7/14] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:24.752594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:24.794859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca78b7-f503-4c8b-8970-71f8a1156222 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:24.797337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:24.832752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:24.833654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.833938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.834213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.835535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:24.854531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24b2e-411d-44f6-8131-1a699c1876cc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:24.888108 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:24.888713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:24.888993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:24.889322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:24.889994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:24.890301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:24.891697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:24.902076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:24.903601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:24.904326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 8/15] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:24.909844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:25.001819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 8/16] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:25.007437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:25.008107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b701f-4640-4b99-9f79-14c0f359d35d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:25.010679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:25.043890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:25.044641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:25.045025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:25.045430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:25.046991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:25.048858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:25.051045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 9/17] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:24 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:25.056548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:25.070915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:25.107029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebbd6d-2642-4148-b0e4-37afab68188e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:25.140124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:25.140971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:25.141297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:25.141570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:25.157552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944701-5d9c-4332-8d15-64b0e48cd3fc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:25.160072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:25.161585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:08:25.180086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:25.180987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:08:25.181858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:08:25.181858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:08:25.181858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:25.181858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 9/18] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:08:25.187625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:25.193274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:25.193924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:25.194209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:25.194485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:25.195611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:25.197551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:25.199686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 10/19] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:25.205226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:25.243754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:25.286727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03709b7-468e-4edd-bbe2-0ef4b40dbeaf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:25.287232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:25.306317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256914eb-a2c9-4c1b-afa9-ec311ff7f99d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:25.319965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:25.320591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:25.320849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:25.321154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:25.321784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:25.322087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:25.324108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f173aa4-e277-4847-848a-a86909ba0704 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:25.341277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:25.341884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:25.342160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:25.342431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:25.343400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.domain.id=default, user.id=4ab308fcca9747a8a7a9f433ecd95299) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:25.343503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 10/20] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:25.343599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:25.344866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a2ae-3b6b-4373-8031-7592475ab972 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:25.352005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 11/21] 10.222.0.88 () {56 vars in 1322 bytes} [Mon Aug 29 23:08:25 2022] GET /identity/v3/role_assignments?user.id=4ab308fcca9747a8a7a9f433ecd95299&scope.domain.id=default&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:27.508277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe533-7697-4bd1-9987-6b86f6df66a7 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:27.508788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe533-7697-4bd1-9987-6b86f6df66a7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:27.508862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fe533-7697-4bd1-9987-6b86f6df66a7 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:27.510267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 11/22] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:27.518574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbc448-fa77-48f3-877b-6355f56c0eec None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:27.519472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbc448-fa77-48f3-877b-6355f56c0eec None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:27.519966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbc448-fa77-48f3-877b-6355f56c0eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:27.542156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e9dbc448-fa77-48f3-877b-6355f56c0eec None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:27.543660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e9dbc448-fa77-48f3-877b-6355f56c0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:27.628846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 12/23] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:27.859542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf6cac-74d7-4510-bc48-a751598dc957 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:27.860230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf6cac-74d7-4510-bc48-a751598dc957 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:27.860713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf6cac-74d7-4510-bc48-a751598dc957 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:27.862572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 12/24] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:27.867518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173ae5-7dca-40c3-8aff-ed873719ebfe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:27.868038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173ae5-7dca-40c3-8aff-ed873719ebfe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:27.868506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd173ae5-7dca-40c3-8aff-ed873719ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:27.894080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fd173ae5-7dca-40c3-8aff-ed873719ebfe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:27.895603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd173ae5-7dca-40c3-8aff-ed873719ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:27.980144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 13/25] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:28.137806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ee53-e474-4469-8a21-084cbda12ffb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.138416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ee53-e474-4469-8a21-084cbda12ffb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.138886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ee53-e474-4469-8a21-084cbda12ffb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.140742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 13/26] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:28.146484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.147018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.147516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.156902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:28.166016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ee53-e474-4469-8a21-084cbda12ffb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:28.182433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:28.185593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:28.298825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ee53-e474-4469-8a21-084cbda12ffb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:28.319591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:28.335769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11e7c-7492-46e1-8ae6-fd65c680892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:28.336632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11e7c-7492-46e1-8ae6-fd65c680892a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.337080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11e7c-7492-46e1-8ae6-fd65c680892a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.337614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11e7c-7492-46e1-8ae6-fd65c680892a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.350300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e11e7c-7492-46e1-8ae6-fd65c680892a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-38e11e7c-7492-46e1-8ae6-fd65c680892a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:28.356696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:28.357558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:28.358409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:28.360827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 14/27] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:28.366875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea502e-9bec-48e6-8532-1e3d809441f4 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.367374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea502e-9bec-48e6-8532-1e3d809441f4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.367827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea502e-9bec-48e6-8532-1e3d809441f4 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.369256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 15/28] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:28.371061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea502e-9bec-48e6-8532-1e3d809441f4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:28.376223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 14/29] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:28.377361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:28.478913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea502e-9bec-48e6-8532-1e3d809441f4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:28.530504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afedb0-db22-4e87-a829-6b0027b90c17 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:28.569852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:28.570552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.570753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.571028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.571283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:28.571705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:28.572298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.573342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.573740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:28.574059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.574936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:28.575425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:28.576998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377858-93ea-444a-a03e-3c7653b4c411 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:28.578998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:28.591475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 15/30] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:28.593097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.593619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.594119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.622204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:28.623407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:28.720813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 16/31] 10.222.0.88 () {60 vars in 1131 bytes} [Mon Aug 29 23:08:28 2022] POST /identity/v3/roles => generated 219 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:28.729311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:28.754705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 16/32] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:28.757135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:28.779047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:28.857321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecd750-4ca0-4d71-b453-a05f49ff39ce None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:28.895787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:28.896813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.897360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.897850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.899999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:28.901963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:28.903877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 17/33] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:28 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:28.910372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:28.918718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d36b70-c332-4fe6-a1aa-f0f345e8c484 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:28.946719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:28.969770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:28.970698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:28.971173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:28.971545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:28.990392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:28.991955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:08:29.019770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:29.020906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:08:29.021874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:08:29.021874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:08:29.021874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:29.023020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 17/34] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:29.029538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:29.039592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397af95-9993-4e17-9d11-54705b963f34 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:29.042541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:29.079823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:29.080830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.081311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.081760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.083337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:29.085282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:29.087103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 18/35] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:29.094043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:29.175231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2971c2-1b31-4602-aeda-c6be94ce6daa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:29.211104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69211-9896-4b24-835d-51392f65281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:29.211783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69211-9896-4b24-835d-51392f65281e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.212061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69211-9896-4b24-835d-51392f65281e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.212332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69211-9896-4b24-835d-51392f65281e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.213564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69211-9896-4b24-835d-51392f65281e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:29.213922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69211-9896-4b24-835d-51392f65281e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:29.215501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69211-9896-4b24-835d-51392f65281e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:29.221144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03faf-f0e8-4781-ad2e-e8cf6642f484 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:29.234781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 18/36] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:29.235629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69211-9896-4b24-835d-51392f65281e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:29.262255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:29.263319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.263852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.264233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] PATH_INFO: `/v3/domains/default/users/4ab308fcca9747a8a7a9f433ecd95299/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.266310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4ab308fcca9747a8a7a9f433ecd95299, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:29.268033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:29.281319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:29.293585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 19/37] 10.222.0.88 () {58 vars in 1361 bytes} [Mon Aug 29 23:08:29 2022] PUT /identity/v3/domains/default/users/4ab308fcca9747a8a7a9f433ecd95299/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:08:29.294492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:29.333335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:29.358891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69211-9896-4b24-835d-51392f65281e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:29.396962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:29.397622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.398119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.398669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.399369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:29.401412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:29.413986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6efe6-2b16-43de-a9fb-360f9581e249 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:29.455891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206896-8ec8-442b-a722-563d5b12a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:29.456879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206896-8ec8-442b-a722-563d5b12a4cd None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.457447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206896-8ec8-442b-a722-563d5b12a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.457956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206896-8ec8-442b-a722-563d5b12a4cd None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.458876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33206896-8ec8-442b-a722-563d5b12a4cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:29.460645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33206896-8ec8-442b-a722-563d5b12a4cd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:29.495143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 20/38] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:08:29 2022] POST /identity/v3/projects => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:29.497093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22600-18b9-410b-8963-ae4d92d9b95c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.497631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22600-18b9-410b-8963-ae4d92d9b95c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.498076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22600-18b9-410b-8963-ae4d92d9b95c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.499720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 21/39] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:29.501426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11e27-7af1-47c1-9e96-eaed87508b49 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.501897 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11e27-7af1-47c1-9e96-eaed87508b49 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.502448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11e27-7af1-47c1-9e96-eaed87508b49 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.504354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 22/40] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:29.505964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed71b-4019-4abf-8185-78fe7572ef4c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.506500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed71b-4019-4abf-8185-78fe7572ef4c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.507005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ed71b-4019-4abf-8185-78fe7572ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.530951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-623ed71b-4019-4abf-8185-78fe7572ef4c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:29.533196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-623ed71b-4019-4abf-8185-78fe7572ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:29.630662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 23/41] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:29.632924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:29.633445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:29.633929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:29.646453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 19/42] 10.222.0.88 () {60 vars in 1131 bytes} [Mon Aug 29 23:08:29 2022] POST /identity/v3/roles => generated 225 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:29.684221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:29.684221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:29.696089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:29.777225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 24/43] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:29.951947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:30.052120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:30.053455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:30.056707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d4e00-691a-461a-8284-a27a52429468 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:30.112504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554714-8935-4397-8616-f09c10296e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:30.113189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554714-8935-4397-8616-f09c10296e2c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:30.113481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554714-8935-4397-8616-f09c10296e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:30.113790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554714-8935-4397-8616-f09c10296e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:30.115016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554714-8935-4397-8616-f09c10296e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:30.116613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554714-8935-4397-8616-f09c10296e2c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:30.118240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 20/44] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:30.124165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554714-8935-4397-8616-f09c10296e2c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:30.163667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04b914-e0fe-49da-8771-f8a1c10cbf47 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:30.198515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c3c2-0f0b-48f1-8b5f-473f4cba846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:30.199286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c3c2-0f0b-48f1-8b5f-473f4cba846b None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:30.199675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c3c2-0f0b-48f1-8b5f-473f4cba846b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:30.200063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c3c2-0f0b-48f1-8b5f-473f4cba846b None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:30.200745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c3c2-0f0b-48f1-8b5f-473f4cba846b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:30.202288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c3c2-0f0b-48f1-8b5f-473f4cba846b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:30.219066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 25/45] 10.222.0.88 () {60 vars in 1131 bytes} [Mon Aug 29 23:08:30 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:30.241698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554714-8935-4397-8616-f09c10296e2c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:30.282282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6356c-62f7-40ee-ad0b-c44dd2ffc65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:30.283022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6356c-62f7-40ee-ad0b-c44dd2ffc65a None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:30.283382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6356c-62f7-40ee-ad0b-c44dd2ffc65a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:30.283737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6356c-62f7-40ee-ad0b-c44dd2ffc65a None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:30.284494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6356c-62f7-40ee-ad0b-c44dd2ffc65a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:30.286145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6356c-62f7-40ee-ad0b-c44dd2ffc65a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:30.319717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 21/46] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:08:30 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:08:31.246096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b930-0ff7-44b2-8496-c971e6273a89 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:31.246615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b930-0ff7-44b2-8496-c971e6273a89 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:31.246615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9b930-0ff7-44b2-8496-c971e6273a89 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:31.247971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 26/47] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:31.253389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:31.253768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:31.253951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:31.273128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:31.274905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:31.289241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:31.343734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 22/48] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:31.615565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b930-0ff7-44b2-8496-c971e6273a89 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:31.620168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:31.720852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9b930-0ff7-44b2-8496-c971e6273a89 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:31.754528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:31.755167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:31.755452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:31.755732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:31.765910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:31.771194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:31.772085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:31.772850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 27/49] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:31.778793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:31.879083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223d34c-ab03-4afd-ba7e-e3fc2d5b46b5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:31.912230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:31.912849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:31.913157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:31.913438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:31.914114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:31.914422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:31.915800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:31.924498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 23/50] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:31.930007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:31.991028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:32.029575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aca3f1-862c-4fb5-8d61-f8ba6e4b2a04 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:32.062152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:32.062774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.063053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.063326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.064439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:32.065934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:32.067520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 28/51] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:31 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:32.073856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:32.086296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:32.177305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136430fc-9e03-4584-89a0-3ff360dd2382 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:32.211406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d21c7-9024-4b5e-9057-77048f135094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:32.212046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d21c7-9024-4b5e-9057-77048f135094 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.212334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d21c7-9024-4b5e-9057-77048f135094 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.212610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d21c7-9024-4b5e-9057-77048f135094 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.213786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d21c7-9024-4b5e-9057-77048f135094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:32.215258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d21c7-9024-4b5e-9057-77048f135094 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:32.216865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 24/52] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:32.222746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:32.252924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f666-5981-4b3c-a221-84803b2df2a4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.253325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f666-5981-4b3c-a221-84803b2df2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.253608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7f666-5981-4b3c-a221-84803b2df2a4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.254942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 25/53] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:08:32.259756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.260677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.261042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.279727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:32.280937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:32.322247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813433c-12e1-464c-994e-7fd7df767d1f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:32.348366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 26/54] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:32.350969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:32.356589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:32.357238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.357518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.357791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.358510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.domain.id=default, user.id=4ab308fcca9747a8a7a9f433ecd95299) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:32.358811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:32.360254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:32.368238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 29/55] 10.222.0.88 () {56 vars in 1322 bytes} [Mon Aug 29 23:08:32 2022] GET /identity/v3/role_assignments?user.id=4ab308fcca9747a8a7a9f433ecd95299&scope.domain.id=default&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:32.622287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:32.632472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:32.721099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe62b4-d8c8-45ff-8a37-10ca45d13e01 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:32.754691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8170a-0271-4fb9-8052-ed8843eda759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:32.755320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8170a-0271-4fb9-8052-ed8843eda759 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.755604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8170a-0271-4fb9-8052-ed8843eda759 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.755882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8170a-0271-4fb9-8052-ed8843eda759 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.756971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8170a-0271-4fb9-8052-ed8843eda759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:32.758498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8170a-0271-4fb9-8052-ed8843eda759 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:32.760825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 27/56] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:32.766179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:32.865691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20dee3-b037-4ba9-865a-4021194c2615 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:32.899278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268edc21-e831-4d48-b0ad-c6760cf3d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:32.899821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268edc21-e831-4d48-b0ad-c6760cf3d692 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:32.900105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268edc21-e831-4d48-b0ad-c6760cf3d692 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:32.900382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268edc21-e831-4d48-b0ad-c6760cf3d692 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:32.901671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268edc21-e831-4d48-b0ad-c6760cf3d692 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:32.903128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268edc21-e831-4d48-b0ad-c6760cf3d692 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:33.035541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 30/57] 10.222.0.88 () {60 vars in 1140 bytes} [Mon Aug 29 23:08:32 2022] POST /identity/v3/projects => generated 298 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:34.917891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6879cc-0115-45b1-9e04-960910fcee54 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:34.918375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6879cc-0115-45b1-9e04-960910fcee54 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:34.918375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6879cc-0115-45b1-9e04-960910fcee54 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:34.919689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 28/58] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:34.924841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:34.925259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:34.925428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:34.943612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:34.944792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:34.987733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:35.010971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 31/59] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:35.281490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6879cc-0115-45b1-9e04-960910fcee54 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:35.358255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:35.381940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6879cc-0115-45b1-9e04-960910fcee54 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:35.415108 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369f73c-4223-47db-b11e-5cfa98b1dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:35.415733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f73c-4223-47db-b11e-5cfa98b1dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:35.416016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f73c-4223-47db-b11e-5cfa98b1dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:35.416347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f73c-4223-47db-b11e-5cfa98b1dcb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:35.417473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369f73c-4223-47db-b11e-5cfa98b1dcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:35.418930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369f73c-4223-47db-b11e-5cfa98b1dcb3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:35.420605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 29/60] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:35.426352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:35.524033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7faf9f-615d-41f3-8cd8-66d50ae923c9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:35.556596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca75bad-dd4f-4fb3-9307-b39b1dee3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:35.557182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75bad-dd4f-4fb3-9307-b39b1dee3610 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:35.557464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75bad-dd4f-4fb3-9307-b39b1dee3610 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:35.557746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca75bad-dd4f-4fb3-9307-b39b1dee3610 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:35.558402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75bad-dd4f-4fb3-9307-b39b1dee3610 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:35.559837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca75bad-dd4f-4fb3-9307-b39b1dee3610 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:35.587120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 32/61] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:08:35 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:08:38.494274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb13c8-1713-49f6-bea2-216277cffc6b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:38.496016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb13c8-1713-49f6-bea2-216277cffc6b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:38.496505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb13c8-1713-49f6-bea2-216277cffc6b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:38.498083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 30/62] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:38.503418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe89607-dea8-4425-ba72-6c94072eebb2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:38.503913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe89607-dea8-4425-ba72-6c94072eebb2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:38.504122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe89607-dea8-4425-ba72-6c94072eebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:38.534140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7fe89607-dea8-4425-ba72-6c94072eebb2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:38.535529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7fe89607-dea8-4425-ba72-6c94072eebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:38.567975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:38.628048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 33/63] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:38.764359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f6fd-c687-40e4-8f19-81db35c16d09 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:38.764952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f6fd-c687-40e4-8f19-81db35c16d09 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:38.765445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f6fd-c687-40e4-8f19-81db35c16d09 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:38.767304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 31/64] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:38.772490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:38.772782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:38.773062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:38.799307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:38.800500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:38.824464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220b41-46be-4bba-9c17-ca369519f65c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:38.825088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220b41-46be-4bba-9c17-ca369519f65c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:38.825492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220b41-46be-4bba-9c17-ca369519f65c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:38.827144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 32/65] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:38.832261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:38.832561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:38.832844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:38.869071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:38.871557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:38.872323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 34/66] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:38.990711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 33/67] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:39.065286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.152576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.185512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.194328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c7e3e-180c-4393-91da-10e3f7ee469d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.267692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01bc66-eca0-4866-a9f4-ec18fe5a3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.268773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01bc66-eca0-4866-a9f4-ec18fe5a3a21 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.269060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01bc66-eca0-4866-a9f4-ec18fe5a3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.269371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01bc66-eca0-4866-a9f4-ec18fe5a3a21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.283905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.285721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01bc66-eca0-4866-a9f4-ec18fe5a3a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2d01bc66-eca0-4866-a9f4-ec18fe5a3a21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:39.293547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:39.294404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:39.295140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 35/68] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:39.298863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e853-fc73-407c-b6c6-975b01825173 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.299707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e853-fc73-407c-b6c6-975b01825173 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.299994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e853-fc73-407c-b6c6-975b01825173 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.301449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 36/69] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:39.302308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d8c2-163b-407c-b72a-9b83037455e3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.302585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d8c2-163b-407c-b72a-9b83037455e3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.302853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d8c2-163b-407c-b72a-9b83037455e3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.304147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 37/70] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:39.308977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d8c2-163b-407c-b72a-9b83037455e3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.325394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf400dc-183d-45f9-b7b0-23c2a4607212 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.365787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab0326-20b6-4bec-a46f-9445188ff4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.366431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0326-20b6-4bec-a46f-9445188ff4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.366720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0326-20b6-4bec-a46f-9445188ff4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.366999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab0326-20b6-4bec-a46f-9445188ff4e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.377629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab0326-20b6-4bec-a46f-9445188ff4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f1ab0326-20b6-4bec-a46f-9445188ff4e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:39.382533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:39.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:39.384427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 34/71] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:39.385605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.385896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.386173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.403725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:39.404921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:39.413871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d8c2-163b-407c-b72a-9b83037455e3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.449664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.450278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.450571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.450851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.451527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:39.451841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:39.453265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7635a2-3997-4628-8ce3-6bad03453473 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:39.465819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 38/72] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:39.467165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.467457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.467740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.472034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 35/73] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:39.472874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.497686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:39.498999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:39.510980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.536091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.574759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4fb1f-ab1f-4a46-b0d6-eb4ca97bbf5e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.577220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 39/74] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:39.577220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.632276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.633375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.633724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.645587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:39.651374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:39.652419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:39.653416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:39.654643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 36/75] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:39.660308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.708267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a31739-d1ec-47f8-b5cf-a08d849d04a5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.746577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.747202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.747488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.747771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.748448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:39.748845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:39.750316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:39.758673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 40/76] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:39.759307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.772061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.793673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abfd1-f99d-4320-9536-34f8b3fa22ac None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.819472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.832414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.833393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.833870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.834286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.848414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:39.850133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:39.852059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 37/77] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:39.852977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.866985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887810e-75e3-4be3-a8a1-40f64edfb627 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.902115 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:39.902734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:39.903038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:39.903319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:39.903986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:39.904292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:39.906149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:39.914022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 41/78] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:39.914820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:39.959603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eb947-2e51-4e65-80f9-5469cc376a04 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:39.983769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:39.999855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.000620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.000909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.001215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.012642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:40.018183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:40.019157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:40.019883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:40.022099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 38/79] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:40.027219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c710be-5c20-4316-9f46-0c4f67006f02 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.028276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.061222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.061872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.062154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.062430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.063579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.065042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.066863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 42/80] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:39 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:40.067541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.083142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.143612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5ddac-09d2-413a-9131-82aa43383d35 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.174302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8185cae-279a-436a-9476-2e482ad179ad None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.179208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.179846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.180127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.180403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.183513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.184431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.186034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 39/81] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:40.186808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.215332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.216224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.216514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.216799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.225748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.292547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.294060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.297882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c9e9-8589-485e-987a-0b89681a5f6b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.308889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.333551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.334120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.334410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.334689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.335822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.337334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.339613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 40/82] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:40.340393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.392211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 43/83] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:40.393156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.435944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.440070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0f68-a524-48aa-9c7e-21a2f377bf78 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.473805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.474418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.474702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.474982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.475651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:40.475960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.477394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.486901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 41/84] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:40.487681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.499261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9150c69-94cb-4049-bb88-f6c3ca70c5ca None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.530137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.532985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.533538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.533813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.534084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.589601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71f692-ffcb-481f-97bf-8fde79a5bd99 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.602437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.604151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.623601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.624237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.624557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.624836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.625520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.626993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.644987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.654938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 42/85] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:08:40 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:40.655776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.728196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 44/86] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:40.729865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.768841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:40.776843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46425441-c0a2-49e9-9c72-cf708786d1d1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.820378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.821012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.821334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.821621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.853955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad04c-b541-42b2-84db-3cfed57f9397 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:40.897617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:40.898267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:40.898553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:40.899096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:40.900249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.902536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.905506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 45/87] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:40.906279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:40.910945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:40.912747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:40.915782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:41.027919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:41.038356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 43/88] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:41.038498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5341ea-a460-49e2-be41-7da36961485b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.039527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.091189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.091843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.092125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.092401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.093727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.096104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.098045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 46/89] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:40 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:41.098830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.190292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ef379-7e27-4186-bfba-96e6b439f5e3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.194520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:41.221564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814e45-179c-40b8-9d46-ea2376de7648 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.240812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.241796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.242788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.243247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.245983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.248317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.251120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 44/90] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:41.252082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.262588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.263207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.263484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.263759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.264498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=8fb4793c3a0843b1ab85af535af499d8) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:41.264904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.266393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.272261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 47/91] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/role_assignments?user.id=8fb4793c3a0843b1ab85af535af499d8&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:41.277450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.345510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:41.391900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb629295-7b59-4c51-bb17-b88c115d02a4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.435454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.436472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.436984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.437628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.439047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.440868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.443202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 45/92] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:41.444957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.527059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74d33-c7cb-4e1a-9efd-821eea1c25d9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.606646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dda43-e49c-4af2-8c33-746523069f46 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.612686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.613878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.614373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.614846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.634064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:41.661148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:41.668574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:41.669220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:41.669499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:41.669775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:41.670508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=4ab308fcca9747a8a7a9f433ecd95299) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:41.670843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.672258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.687803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 46/93] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/role_assignments?user.id=4ab308fcca9747a8a7a9f433ecd95299&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:41.688468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.768060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:41.769706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:41.888383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 48/94] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:41.894802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:41.959788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439991b5-17ed-4a28-81c9-1463b31158fa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:41.987543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:42.032756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:42.033421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:42.033713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:42.034154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:42.035552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] RBAC: Adding query filter params (role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=8fb4793c3a0843b1ab85af535af499d8) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:42.035874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:42.037351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:42.049047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 47/95] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/role_assignments?user.id=8fb4793c3a0843b1ab85af535af499d8&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 259 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:42.128283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fd4b-c24c-4c71-8f07-14f00f3de2b1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:42.183043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446e5bf-f181-4d6f-926b-e23a46fc4f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:42.183717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446e5bf-f181-4d6f-926b-e23a46fc4f6e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:42.184006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446e5bf-f181-4d6f-926b-e23a46fc4f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:42.184286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446e5bf-f181-4d6f-926b-e23a46fc4f6e None admin] PATH_INFO: `/v3/projects/5222d96350024b0dbbecd74a310f31a7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:42.190055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446e5bf-f181-4d6f-926b-e23a46fc4f6e None admin] RBAC: Authorizing `identity:get_project(project_id=5222d96350024b0dbbecd74a310f31a7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:42.191574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446e5bf-f181-4d6f-926b-e23a46fc4f6e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:42.193425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 49/96] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:41 2022] GET /identity/v3/projects/5222d96350024b0dbbecd74a310f31a7 => generated 312 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:42.201073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:42.297840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:42.356530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5283f-8ed5-4445-96f5-ac9622c2f716 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:42.403701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:42.404320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:42.404603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:42.404881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:42.405632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=5222d96350024b0dbbecd74a310f31a7, user.id=8fb4793c3a0843b1ab85af535af499d8) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:42.405971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:42.407433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28514b4b-0589-46b4-bcbd-328e6b89bec0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:42.416931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 48/97] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:42 2022] GET /identity/v3/role_assignments?user.id=8fb4793c3a0843b1ab85af535af499d8&scope.project.id=5222d96350024b0dbbecd74a310f31a7&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:43.130668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21baa3-6aad-4495-b0f3-ea90aae9d5e7 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:43.131677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21baa3-6aad-4495-b0f3-ea90aae9d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:43.132193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21baa3-6aad-4495-b0f3-ea90aae9d5e7 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:43.133787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 50/98] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:43.139348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c500-7de5-4748-a2c9-a35296b823b4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:43.140197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c500-7de5-4748-a2c9-a35296b823b4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:43.140700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c500-7de5-4748-a2c9-a35296b823b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:43.163726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d5f1c500-7de5-4748-a2c9-a35296b823b4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:43.165302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d5f1c500-7de5-4748-a2c9-a35296b823b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:43.237797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 49/99] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:43.473284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147302f-cc91-458a-8e76-db4ba674c4cf None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:43.473888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147302f-cc91-458a-8e76-db4ba674c4cf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:43.474387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147302f-cc91-458a-8e76-db4ba674c4cf None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:43.475941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 51/100] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:43.483631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:43.483935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:43.484227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:43.507598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:43.508798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:43.569377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:43.595478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 50/101] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:43.805070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147302f-cc91-458a-8e76-db4ba674c4cf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:43.930452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147302f-cc91-458a-8e76-db4ba674c4cf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:43.940390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:43.971570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:43.972568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:43.973070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:43.973596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:43.985641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:43.990773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:43.991674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:08:43.992420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:43.995048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 52/102] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:44.000498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.048075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.153405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5857051-e545-4793-a521-9827bc1d35a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:44.191013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:44.191629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.191914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.192192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.192867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:44.193213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:44.194621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d04385-22f6-4f27-802e-3cafc8b4bd9d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:44.203485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 51/103] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:44.204694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cdcf2-81ec-460a-be5c-9512925d7c71 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.204985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cdcf2-81ec-460a-be5c-9512925d7c71 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.205305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cdcf2-81ec-460a-be5c-9512925d7c71 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.206780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 52/104] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:44.216918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.217234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.217514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.248534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:44.250383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:44.254528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14441cb-1bab-423f-9014-3ab7d5760849 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:44.319997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:44.320650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.320934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.321239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.325795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:44.327288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:44.329080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 53/105] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:44.329783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.330771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:44.345205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 53/106] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:44.345902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.397588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:44.451892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca17a-bd1c-4dfe-a0c4-158fde96c8c5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:44.490109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:44.490788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.491082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.491361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.492019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:44.493551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:44.506766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f50454-29f0-4778-9220-1985549a2516 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:44.535634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 54/107] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:08:44 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:44.570956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:44.571624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.571910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.572191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] PATH_INFO: `/v3/users/fe87b5aee232481096ab93bb08d2a331` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.605969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] RBAC: Authorizing `identity:get_user(user_id=fe87b5aee232481096ab93bb08d2a331)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:44.607484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:44.609252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 54/108] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:44 2022] GET /identity/v3/users/fe87b5aee232481096ab93bb08d2a331 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:44.615046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.643855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.669541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:44.742408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee56c-359c-416d-9310-ca619a343719 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:44.781329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339f8c6-2afd-4983-9398-872c1fe14dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:44.781970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339f8c6-2afd-4983-9398-872c1fe14dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.782260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339f8c6-2afd-4983-9398-872c1fe14dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.782609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339f8c6-2afd-4983-9398-872c1fe14dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.816900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:44.833262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eca22f-8977-4950-9102-6cec836bc640 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:44.864568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339f8c6-2afd-4983-9398-872c1fe14dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:44.866412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339f8c6-2afd-4983-9398-872c1fe14dc2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:44.880792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713319e-2a30-44d3-b6da-6fd4651593db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:44.881722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713319e-2a30-44d3-b6da-6fd4651593db None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.882980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713319e-2a30-44d3-b6da-6fd4651593db None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.883403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713319e-2a30-44d3-b6da-6fd4651593db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.895999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713319e-2a30-44d3-b6da-6fd4651593db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-c713319e-2a30-44d3-b6da-6fd4651593db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:44.901675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:44.902549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:44.903301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:44.904805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:44.905575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 55/109] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:08:44.906990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fef2-65b7-4ed9-8700-2b7d620d812d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.907419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fef2-65b7-4ed9-8700-2b7d620d812d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.907843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978fef2-65b7-4ed9-8700-2b7d620d812d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:44.910424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 56/110] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:44.913991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978fef2-65b7-4ed9-8700-2b7d620d812d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:44.986915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 55/111] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:44.988377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:44.988730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:44.989294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.012222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:45.013828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:45.035096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978fef2-65b7-4ed9-8700-2b7d620d812d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.073503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.074508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.074934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.075393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.076276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:45.076785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:45.078531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750ec1-78ab-44a5-9118-880692505d8a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:45.087991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 57/112] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:45.094099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028172-d854-4912-a624-1f424addcf0a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.094566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028172-d854-4912-a624-1f424addcf0a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.095011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028172-d854-4912-a624-1f424addcf0a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.096648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 58/113] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:45.097577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028172-d854-4912-a624-1f424addcf0a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.100989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 56/114] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:45.102871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.136088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:45.187983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:45.263168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3028172-d854-4912-a624-1f424addcf0a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.277657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850f1d0-0ea9-45ff-9fb7-1a51b1d62869 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.305728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ac584-1a5c-4296-8787-776612c49fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.306955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac584-1a5c-4296-8787-776612c49fae None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.307795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac584-1a5c-4296-8787-776612c49fae None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.308278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac584-1a5c-4296-8787-776612c49fae None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.309680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ac584-1a5c-4296-8787-776612c49fae None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:45.311564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ac584-1a5c-4296-8787-776612c49fae None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:45.312448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762dea7-7e78-4d21-bbaa-b1e2e4d9a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.313327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dea7-7e78-4d21-bbaa-b1e2e4d9a29a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.313748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dea7-7e78-4d21-bbaa-b1e2e4d9a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.314228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762dea7-7e78-4d21-bbaa-b1e2e4d9a29a None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.314327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 59/115] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:45.315562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.315856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.316137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.316312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762dea7-7e78-4d21-bbaa-b1e2e4d9a29a None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:45.317965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762dea7-7e78-4d21-bbaa-b1e2e4d9a29a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:45.320265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 57/116] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:45.321724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518dd2-4fc5-4b09-99df-f1f86c56191a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.322208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518dd2-4fc5-4b09-99df-f1f86c56191a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.323192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55518dd2-4fc5-4b09-99df-f1f86c56191a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.324601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 58/117] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:45.329260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518dd2-4fc5-4b09-99df-f1f86c56191a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.337518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:45.339448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:45.414279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 60/118] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:45.422172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.436744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55518dd2-4fc5-4b09-99df-f1f86c56191a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.445181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:45.465892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:45.476075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.476932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.477429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.477923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.478974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] RBAC: Adding query filter params (role.id=316f0e38f78f4eb09fca1ae4e603f5ab, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=fe87b5aee232481096ab93bb08d2a331) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:45.479483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:45.481145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90777383-a4d0-484f-a3b4-eca896b73931 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:45.487291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 59/119] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/role_assignments?user.id=fe87b5aee232481096ab93bb08d2a331&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=316f0e38f78f4eb09fca1ae4e603f5ab => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:45.488686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.489224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.489692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.517130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:45.519789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:45.598068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a8736-4978-4c91-9067-d2eff749e529 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.635676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.636328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.636613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.636887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.637653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 60/120] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:45.638146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:45.638915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.644973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:45.644973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 61/121] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:45.647326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.796812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:45.832893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad6e37-b538-44dd-94a6-c333d75300c0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.848509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0386f-514f-48f5-9639-0dcdead98706 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:45.874331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:45.890772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.892226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:45.893155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.894002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:45.894477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.894963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/8fb4793c3a0843b1ab85af535af499d8/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.895434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:45.896702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:45.899973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6d401ac09b64a7a84d25278403a2720, user_id=8fb4793c3a0843b1ab85af535af499d8, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:45.902098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:45.917939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:45.923719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:45.925350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:45.926649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:45.937695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 62/122] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:08:45 2022] PUT /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/8fb4793c3a0843b1ab85af535af499d8/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:08:45.939584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:45.944017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 61/123] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:45.952716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.123346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad7741-65b4-46b3-9759-4d5748def760 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.138163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c429-1670-4f18-8dd4-dfa08985170d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.173893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.174957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.175439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.175985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.176966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:46.177463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.177722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:46.178102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.178380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.178656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.179937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:46.187768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:46.192092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:46.192938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 62/124] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:46.196301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:46.199793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:46.200639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:46.201413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:46.203769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 63/125] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:08:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:46.212438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.245726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:46.321532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705756-fb9a-437e-9a35-9e541f0e0a7e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.345994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f76d8c-889f-421c-9bad-dddeeb0fb977 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.388633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.389159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.389276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.389490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.389767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.390579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.391052 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.391519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.392381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:46.392874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:46.394898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:46.405812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 64/126] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:46.407223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.418620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:46.429145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:46.430039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 63/127] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:46.430803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.552077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baf331-57b9-4663-904e-681ff16ba955 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.560419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:46.577502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:46.627625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.629665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.629947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.630221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.632308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:46.635716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:46.642526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 64/128] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:46.643331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.668800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a94c81-dbba-4f58-bce8-7ddd79ba5073 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.758453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.759106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.759383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.759657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.762572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:46.764064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:46.765876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 65/129] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:46.767471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.806201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996f26-cd3c-40c6-9ea0-52a9bc594bd7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.868818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.869740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.870182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.870468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.871255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:46.871569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:46.873099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:46.882611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 65/130] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:46.883647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:46.917382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c870a-f7bb-4462-84cb-0f4ecf618f12 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:46.946029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:46.958834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:46.979161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:46.979878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:46.980166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:46.980449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:46.985896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:46.987383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:46.989076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 66/131] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:46.989865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:47.032987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122cd9d8-5bab-4745-8a67-e996bf3ff6fc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:47.080173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:47.081202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.081713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.082188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.083507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:47.085210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:47.087055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 66/132] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:47.093167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:47.139028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4879c-2fb9-4205-833c-944d53335fe4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:47.175087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:47.175679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.175963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.176241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.177412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:47.178876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:47.180658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 67/133] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:46 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:47.181328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:47.212772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:47.220738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b021e5d-ccae-4d8e-9b92-4765395c4f79 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:47.251862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:47.267867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95fd02-5f9a-478b-a794-9ea89e97ce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:47.268576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95fd02-5f9a-478b-a794-9ea89e97ce50 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.268864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95fd02-5f9a-478b-a794-9ea89e97ce50 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.269165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95fd02-5f9a-478b-a794-9ea89e97ce50 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/8fb4793c3a0843b1ab85af535af499d8/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.271612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95fd02-5f9a-478b-a794-9ea89e97ce50 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6d401ac09b64a7a84d25278403a2720, user_id=8fb4793c3a0843b1ab85af535af499d8, role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:47.273092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95fd02-5f9a-478b-a794-9ea89e97ce50 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:47.299481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 67/134] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:08:47 2022] PUT /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/8fb4793c3a0843b1ab85af535af499d8/roles/735d69de30e14d03a5a17f594ad42f5a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:47.299481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484443f-39a9-4417-ba8f-4d04d80318f5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.299481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484443f-39a9-4417-ba8f-4d04d80318f5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.299481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484443f-39a9-4417-ba8f-4d04d80318f5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.299481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 68/135] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:47.300323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484443f-39a9-4417-ba8f-4d04d80318f5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:47.308710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80547a-fbf8-49d8-896f-9c52556345fa None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:47.390983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abdcb5-4b84-4726-b23b-a88df752e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:47.391779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdcb5-4b84-4726-b23b-a88df752e98b None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.392070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdcb5-4b84-4726-b23b-a88df752e98b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.392399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abdcb5-4b84-4726-b23b-a88df752e98b None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/4ab308fcca9747a8a7a9f433ecd95299/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.394590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abdcb5-4b84-4726-b23b-a88df752e98b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6d401ac09b64a7a84d25278403a2720, user_id=4ab308fcca9747a8a7a9f433ecd95299, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:47.396152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abdcb5-4b84-4726-b23b-a88df752e98b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:47.420219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 68/136] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:08:47 2022] PUT /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/4ab308fcca9747a8a7a9f433ecd95299/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:47.423178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952bfd3-4785-4e14-9819-b23e3733c6d1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.424955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952bfd3-4785-4e14-9819-b23e3733c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.425374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952bfd3-4785-4e14-9819-b23e3733c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.451394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484443f-39a9-4417-ba8f-4d04d80318f5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:47.470227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d952bfd3-4785-4e14-9819-b23e3733c6d1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:47.475134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d952bfd3-4785-4e14-9819-b23e3733c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:47.550596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:47.551261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.551544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.551832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] PATH_INFO: `/v3/projects/5222d96350024b0dbbecd74a310f31a7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.558160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] RBAC: Authorizing `identity:get_project(project_id=5222d96350024b0dbbecd74a310f31a7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:47.559682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:47.561509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 69/137] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:47 2022] GET /identity/v3/projects/5222d96350024b0dbbecd74a310f31a7 => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:47.570189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:47.582561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 69/138] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:47.644471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:47.732871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c3f75-f94a-410a-89a4-7b8ceb803197 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:47.768337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8ace6-7e45-4b00-a97b-7ee114a4d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:47.769003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8ace6-7e45-4b00-a97b-7ee114a4d815 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.769321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8ace6-7e45-4b00-a97b-7ee114a4d815 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.769611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8ace6-7e45-4b00-a97b-7ee114a4d815 None admin] PATH_INFO: `/v3/projects/5222d96350024b0dbbecd74a310f31a7/users/8fb4793c3a0843b1ab85af535af499d8/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.771537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8ace6-7e45-4b00-a97b-7ee114a4d815 None admin] RBAC: Authorizing `identity:create_grant(project_id=5222d96350024b0dbbecd74a310f31a7, user_id=8fb4793c3a0843b1ab85af535af499d8, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:47.772980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8ace6-7e45-4b00-a97b-7ee114a4d815 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:47.799100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 70/139] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:08:47 2022] PUT /identity/v3/projects/5222d96350024b0dbbecd74a310f31a7/users/8fb4793c3a0843b1ab85af535af499d8/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:47.918426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781642a7-3a2e-4c26-8e02-ce14309810ca None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.918769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781642a7-3a2e-4c26-8e02-ce14309810ca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.918994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781642a7-3a2e-4c26-8e02-ce14309810ca None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.920521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 70/140] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:47.925714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:47.926001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:47.926275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:47.954243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:47.955483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:48.051554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 71/141] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:48.157436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781642a7-3a2e-4c26-8e02-ce14309810ca None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:48.221556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:48.308555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781642a7-3a2e-4c26-8e02-ce14309810ca None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:48.372864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:48.373950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.374441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.374924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.380125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:48.382980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:48.386031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 71/142] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:48.394816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:48.419046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:48.448272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:48.599852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebfefc-76f6-475e-83b5-0c5424dbb148 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:48.646646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:48.653871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af40f02-067e-4570-81bb-da93b80ac2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:48.654534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40f02-067e-4570-81bb-da93b80ac2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.654815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40f02-067e-4570-81bb-da93b80ac2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.655089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af40f02-067e-4570-81bb-da93b80ac2a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.671118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af40f02-067e-4570-81bb-da93b80ac2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:48.673030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e797-0e80-490b-a141-8466dcb16a39 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-0af40f02-067e-4570-81bb-da93b80ac2a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:48.680065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:48.680906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:08:48.682249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:48.686850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 72/143] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:48.688010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc170e-6422-4227-94ab-d942c9382f14 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.688811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc170e-6422-4227-94ab-d942c9382f14 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.689094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc170e-6422-4227-94ab-d942c9382f14 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.693659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 73/144] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:48.694389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc170e-6422-4227-94ab-d942c9382f14 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:48.741859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7011d6-8c11-4bcf-bb81-fcb6955aed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:48.742538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7011d6-8c11-4bcf-bb81-fcb6955aed7b None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.742816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7011d6-8c11-4bcf-bb81-fcb6955aed7b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.743089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7011d6-8c11-4bcf-bb81-fcb6955aed7b None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.743738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7011d6-8c11-4bcf-bb81-fcb6955aed7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:48.747009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7011d6-8c11-4bcf-bb81-fcb6955aed7b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:48.794546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 72/145] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:08:48 2022] POST /identity/v3/users => generated 283 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:48.795929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.796305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.796585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.835873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:48.837132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:48.857286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc170e-6422-4227-94ab-d942c9382f14 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:48.893148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:48.893829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:48.894120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:48.894388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:48.895063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:48.895418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:48.896852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:48.907246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 74/146] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:48.913691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:48.983274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 73/147] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:49.027397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:49.113357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7618c-e716-427f-9f87-d50d5033add4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:49.155196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:49.155832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.156110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.156381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] PATH_INFO: `/v3/users/fe87b5aee232481096ab93bb08d2a331` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.157534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] RBAC: Authorizing `identity:get_user(user_id=fe87b5aee232481096ab93bb08d2a331)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:49.158984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:49.160561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 75/148] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:48 2022] GET /identity/v3/users/fe87b5aee232481096ab93bb08d2a331 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:49.166789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:49.174534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:49.302964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b007d-e027-4ca7-96ca-9346c1a33fba None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:49.350770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:49.351412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.351695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.351965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.353123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:49.354648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:49.356504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 74/149] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:49 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:49.362140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:49.399954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:49.490722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1289e-d360-4724-a920-3edc052d230c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:49.521490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:49.539054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:49.539739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.540016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.540292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/fe87b5aee232481096ab93bb08d2a331/roles/316f0e38f78f4eb09fca1ae4e603f5ab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.542541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] RBAC: Authorizing `identity:create_grant(project_id=a6d401ac09b64a7a84d25278403a2720, user_id=fe87b5aee232481096ab93bb08d2a331, role_id=316f0e38f78f4eb09fca1ae4e603f5ab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:49.544165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:49.554079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:49.563533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 76/150] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:08:49 2022] PUT /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720/users/fe87b5aee232481096ab93bb08d2a331/roles/316f0e38f78f4eb09fca1ae4e603f5ab => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:49.616940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f876e34-b5f2-4ef7-842e-c8b06a59e579 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:49.661574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:49.662523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.662990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.663444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.675875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:49.682120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:49.683308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:49.684229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:49.686729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 75/151] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:08:49.692807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:49.813412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b52c9-9b9f-47d0-bc8a-cca88074aaec None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:49.852747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:49.853400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:49.854206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:49.854539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:49.855215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:49.855513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:49.856901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:49.866294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 77/152] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:49.872097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:49.986930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075fad0-f4b9-44a1-9901-c6812e39234a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:50.021221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:50.028328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf3a6a-3278-4d1b-875d-5d53d49cb779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:50.029041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3a6a-3278-4d1b-875d-5d53d49cb779 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.029505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3a6a-3278-4d1b-875d-5d53d49cb779 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.029989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3a6a-3278-4d1b-875d-5d53d49cb779 None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.031176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3a6a-3278-4d1b-875d-5d53d49cb779 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:50.032664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3a6a-3278-4d1b-875d-5d53d49cb779 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:50.034500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 76/153] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:49 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:50.040350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:50.083318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:50.162321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9d53-1910-46c1-a2ba-bedcdb7871c1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:50.198548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:50.199223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.199500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.199769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.272342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:50.274187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:50.293652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa6195-5955-441d-b10a-c257fe2172dc None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.293980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa6195-5955-441d-b10a-c257fe2172dc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.294205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa6195-5955-441d-b10a-c257fe2172dc None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.296358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 77/154] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:50.302601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.302877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.303311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.328641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:50.346195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:50.347414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:50.412701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 78/155] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:50.418546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:50.494971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 78/156] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:50.560751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70dc3-05f1-4f38-8f65-45548b91b005 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:50.605530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:50.606199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.606479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.606753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.607930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:50.609460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:50.611298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 79/157] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:50 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:50.616981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:50.749747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16df7dd-59c4-41b5-9df5-f3ceb6923475 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:50.781765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:50.788069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:50.788698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:50.789221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:50.789425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:50.790245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=8fb4793c3a0843b1ab85af535af499d8) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:50.790601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:50.793223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13190af5-470c-4798-b93b-ab26a8ff1e05 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:50.801807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 79/158] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:50 2022] GET /identity/v3/role_assignments?user.id=8fb4793c3a0843b1ab85af535af499d8&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:50.877507 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:50.882552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:50.998617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625afe53-3f67-46fe-8254-95ef390f0496 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:51.035091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:51.035741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.036023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.036299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.039648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b80af-2f49-42fe-910c-d8622b2d4d25 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.039941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b80af-2f49-42fe-910c-d8622b2d4d25 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.040217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b80af-2f49-42fe-910c-d8622b2d4d25 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.041815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 80/159] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:51.055160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:51.058964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75b1b-0923-45c8-9e9f-9cdd58636196 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.059251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75b1b-0923-45c8-9e9f-9cdd58636196 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.059531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc75b1b-0923-45c8-9e9f-9cdd58636196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:51.061810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:51.062694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:51.063462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 80/160] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:51.071604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:51.089760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bcc75b1b-0923-45c8-9e9f-9cdd58636196 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:51.090984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bcc75b1b-0923-45c8-9e9f-9cdd58636196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:51.158331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:51.202445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c1227-c2c3-4785-8852-863df95f1a30 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:51.242609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:51.243610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.244088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.245747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.246568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:51.246885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:51.248297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:51.263723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 81/161] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:51.264833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060615-1b57-416b-a04f-c2d2b2d4ee77 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.265140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060615-1b57-416b-a04f-c2d2b2d4ee77 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.265413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d060615-1b57-416b-a04f-c2d2b2d4ee77 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.266782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 82/162] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:51.271150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 81/163] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:51.272292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.272466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.272731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.277899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:51.318143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:51.319340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:51.459515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 83/164] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:51.490382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b639c-ee5a-47e3-b618-360a43e6e8e0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:51.526197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:51.536639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:51.537377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.537662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.537943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] PATH_INFO: `/v3/users/4ab308fcca9747a8a7a9f433ecd95299` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.539077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] RBAC: Authorizing `identity:get_user(user_id=4ab308fcca9747a8a7a9f433ecd95299)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:51.540614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:51.542956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 82/165] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:51 2022] GET /identity/v3/users/4ab308fcca9747a8a7a9f433ecd95299 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:51.550275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:51.645775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:51.699907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246016c-48dd-4a5a-87d2-65b15534a076 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:51.744042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:51.745224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:51.745505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:51.745786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:51.829356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:51.830895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:51.862163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:51.930111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.019087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 84/166] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:52.019877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.056704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82577786-20d7-48b4-b4c6-e87b3b74de2f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.095867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.096749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.097205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.097658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.122917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:52.128653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:52.129834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:52.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:52.141143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 83/167] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:08:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:52.143165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.192753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddc201-d927-4464-b9dc-d517f3c9ea76 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.234602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.235737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.236165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.236583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.253794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:52.264470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:52.265659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:52.266604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:52.268505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 85/168] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:52.269647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.298842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.299454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.407566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e3216-2f96-416e-a77f-8652c8a8e601 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.442492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397f942-1f45-4c07-966a-f5470f73b223 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.485717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.486749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.487254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.487745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.492283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.493999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.496441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 84/169] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:52.497452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.529616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.530169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.530452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.530729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.531407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:52.531710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.533368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.548648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 86/170] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:52.549621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.688429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.712777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d848b1-0dfe-4f14-be4c-f4a7b4687e99 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.732770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a66b3f-c167-47a6-8476-540c39abda2f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:52.749313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.753149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.755816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.756104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.757691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=4ab308fcca9747a8a7a9f433ecd95299) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:52.758004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.759473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.777190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 87/171] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/role_assignments?user.id=4ab308fcca9747a8a7a9f433ecd95299&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:52.777806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:52.782109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.802507 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:52.803257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:52.803544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:52.803822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:52.804512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:52.804819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:52.806248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:52.829385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 85/172] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:52.835247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:52.961227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22a0a0-3b36-44f5-bfb6-e58d000d73aa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.001766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.002472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.002755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.003033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.004315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.006007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.007679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 88/173] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:53.014408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.039472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.085098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6ef3a-b39f-44d2-869d-cb5a35905390 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.141233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c22b-1bc3-4cb6-9276-42673ec51488 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.162778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5581d7-851c-4c7d-9106-7e13354fc64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.163440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5581d7-851c-4c7d-9106-7e13354fc64b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.163720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5581d7-851c-4c7d-9106-7e13354fc64b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.163993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5581d7-851c-4c7d-9106-7e13354fc64b None admin] PATH_INFO: `/v3/users/8fb4793c3a0843b1ab85af535af499d8` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.165173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5581d7-851c-4c7d-9106-7e13354fc64b None admin] RBAC: Authorizing `identity:get_user(user_id=8fb4793c3a0843b1ab85af535af499d8)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.167529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5581d7-851c-4c7d-9106-7e13354fc64b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.169649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 86/174] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:52 2022] GET /identity/v3/users/8fb4793c3a0843b1ab85af535af499d8 => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:53.171018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369219a-194f-4762-88d1-0f1143bee560 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.171446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369219a-194f-4762-88d1-0f1143bee560 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.171862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369219a-194f-4762-88d1-0f1143bee560 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.177407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 87/175] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:53.179215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369219a-194f-4762-88d1-0f1143bee560 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.182386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8dcc-03f4-41dc-8046-bd894edb42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.183319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8dcc-03f4-41dc-8046-bd894edb42d9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.183762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8dcc-03f4-41dc-8046-bd894edb42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.184192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8dcc-03f4-41dc-8046-bd894edb42d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.257580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.262659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8dcc-03f4-41dc-8046-bd894edb42d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.264493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8dcc-03f4-41dc-8046-bd894edb42d9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.281532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.305629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369219a-194f-4762-88d1-0f1143bee560 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.341819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e99ad5-1e91-410c-8333-53034fff817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.342716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e99ad5-1e91-410c-8333-53034fff817d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.343150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e99ad5-1e91-410c-8333-53034fff817d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.343576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e99ad5-1e91-410c-8333-53034fff817d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.385644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 89/176] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:53.387164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269f6ed-df63-4127-bd02-73eb063f2912 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.387466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269f6ed-df63-4127-bd02-73eb063f2912 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.387748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269f6ed-df63-4127-bd02-73eb063f2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.411483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a269f6ed-df63-4127-bd02-73eb063f2912 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:53.412705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a269f6ed-df63-4127-bd02-73eb063f2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:53.423911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e99ad5-1e91-410c-8333-53034fff817d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.425807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e99ad5-1e91-410c-8333-53034fff817d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.488349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 90/177] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:53.489408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.490239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10a55c-4a85-4806-8031-4374f4512e6f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.490352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10a55c-4a85-4806-8031-4374f4512e6f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.490669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10a55c-4a85-4806-8031-4374f4512e6f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.492235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 91/178] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:53.496081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10a55c-4a85-4806-8031-4374f4512e6f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.571880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 88/179] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:53.578491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.579065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.579490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.599110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:53.600529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:53.601173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.608813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10a55c-4a85-4806-8031-4374f4512e6f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.646972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832fc2b-49b0-4843-aa83-d55564103b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.647617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fc2b-49b0-4843-aa83-d55564103b59 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.647900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fc2b-49b0-4843-aa83-d55564103b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.648179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fc2b-49b0-4843-aa83-d55564103b59 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.649650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832fc2b-49b0-4843-aa83-d55564103b59 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.651787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832fc2b-49b0-4843-aa83-d55564103b59 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.653904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 92/180] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:53.655675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a6a4-45da-4407-b1ca-97366c7bf224 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.656265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a6a4-45da-4407-b1ca-97366c7bf224 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.656740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27a6a4-45da-4407-b1ca-97366c7bf224 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.658252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 93/181] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:53.659901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27a6a4-45da-4407-b1ca-97366c7bf224 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.682371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 89/182] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:53.683243 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.816793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27a6a4-45da-4407-b1ca-97366c7bf224 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.825560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.832536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:53.855227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602df6aa-cbe0-445b-8b8a-768bcaa0cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.856198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602df6aa-cbe0-445b-8b8a-768bcaa0cc82 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.856706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602df6aa-cbe0-445b-8b8a-768bcaa0cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.857190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602df6aa-cbe0-445b-8b8a-768bcaa0cc82 None admin] PATH_INFO: `/v3/projects/5222d96350024b0dbbecd74a310f31a7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.858607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602df6aa-cbe0-445b-8b8a-768bcaa0cc82 None admin] RBAC: Authorizing `identity:get_project(project_id=5222d96350024b0dbbecd74a310f31a7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.860244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602df6aa-cbe0-445b-8b8a-768bcaa0cc82 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.862500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 94/183] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/projects/5222d96350024b0dbbecd74a310f31a7 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:53.863893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.864514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.864975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.870734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eeede6-49e8-4fbb-a05f-ccf1faa29100 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:53.884403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:53.885929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:53.913724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:53.914679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:53.915139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:53.915627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:53.917273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] RBAC: Adding query filter params (role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=8fb4793c3a0843b1ab85af535af499d8) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:53.917808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:53.919492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:53.926200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 90/184] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/role_assignments?user.id=8fb4793c3a0843b1ab85af535af499d8&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:53.927336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:53.968217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 95/185] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:53.969177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.092408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af1115-6d55-4b4c-b892-a4fe6a2571b5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.095104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.114442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f228a-829c-4020-b708-a3a86aef7f24 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.133996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.135303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.135807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.136230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.137148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=5222d96350024b0dbbecd74a310f31a7, user.id=8fb4793c3a0843b1ab85af535af499d8) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:54.137602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.139374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.145968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 96/186] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/role_assignments?user.id=8fb4793c3a0843b1ab85af535af499d8&scope.project.id=5222d96350024b0dbbecd74a310f31a7&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:54.146801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.171465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cd24e-de1f-4ac9-b129-db4851e409f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.172496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cd24e-de1f-4ac9-b129-db4851e409f2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.173004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cd24e-de1f-4ac9-b129-db4851e409f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.173563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cd24e-de1f-4ac9-b129-db4851e409f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.189278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cd24e-de1f-4ac9-b129-db4851e409f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-008cd24e-de1f-4ac9-b129-db4851e409f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:54.195331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:54.196301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:54.197073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:54.200468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 91/187] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:54.202012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9b12-c4a4-4e47-9cc6-399e8c2374c2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.202525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9b12-c4a4-4e47-9cc6-399e8c2374c2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.202998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea9b12-c4a4-4e47-9cc6-399e8c2374c2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.204548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 92/188] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:54.209865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9b12-c4a4-4e47-9cc6-399e8c2374c2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.222535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.284738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4066e-2f4a-4907-9ea6-e7c794cfbc65 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.329526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d1b1a-352e-4f26-a2fb-9f1d839df5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.330257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1b1a-352e-4f26-a2fb-9f1d839df5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.330546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1b1a-352e-4f26-a2fb-9f1d839df5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.330888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1b1a-352e-4f26-a2fb-9f1d839df5e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.344356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d1b1a-352e-4f26-a2fb-9f1d839df5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-861d1b1a-352e-4f26-a2fb-9f1d839df5e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:54.350265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:54.351355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:54.352243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 97/189] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:54.353064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.353064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.353223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.367874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea9b12-c4a4-4e47-9cc6-399e8c2374c2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.374067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:54.375269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:54.406809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.407016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.407433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.407718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.408042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.408800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:54.408981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.410400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.420660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 93/190] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:54.421560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.455425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 98/191] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:54.456402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.500451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.537134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76dd61-1d12-4906-a7b7-350d3a249e87 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.562098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a780dd-b168-497f-81fc-91e239b1a453 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.575563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.576253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.576695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.576966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.578758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.580668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.582482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 94/192] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:54.583066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.598128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.598680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.598962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.599237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.599905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:54.600389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.601616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.610894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 99/193] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:54.611716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.637102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.706516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840778a5-9c36-49e8-a2ea-5de155500514 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.721496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725d201-1396-4a2f-80dc-537bb968eb30 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.747083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.747877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.748160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.748434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] PATH_INFO: `/v3/users/3e6413d2d540447caf7c1370a3f988ac` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.752366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.758796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.759414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.759812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.760119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.760863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.762354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.764930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] RBAC: Authorizing `identity:get_user(user_id=3e6413d2d540447caf7c1370a3f988ac)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.766605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.768587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 95/194] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/users/3e6413d2d540447caf7c1370a3f988ac => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:54.769535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.786653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 100/195] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:08:54 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:54.787489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.884422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:54.903857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541f3bb-fc93-4624-a960-d8426f4b315b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.914485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5812e-ce76-41ca-90cd-a796bf2d2dc6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:54.946343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.946985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.947785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.948062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] PATH_INFO: `/v3/users/fe87b5aee232481096ab93bb08d2a331` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:54.949494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=fe87b5aee232481096ab93bb08d2a331)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:54.951364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:54.952655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 96/196] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/users/fe87b5aee232481096ab93bb08d2a331 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:54.953494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:54.955878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:54.956506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:54.956786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:54.957058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.034396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.041982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.042805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.084364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad5d9b-36da-432a-a937-f3cdd6bd8ee9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.130095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.131322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.131611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.131889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.147881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:55.155468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:55.156373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 97/197] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:55.157613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.158554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.181405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 101/198] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:55.183425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.288429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a1f8b-863e-4015-826d-3a031e5d2169 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.305337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64978f5-6ad6-42b5-b138-c0013d9291f8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.316141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.329528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.330536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.331050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.331527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.344765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.345638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.345845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.346119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.346803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:55.347106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.348660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.358650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 102/199] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:55.359395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.404632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.417556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.419371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.481492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262d5cb-d7e4-406f-9e84-0097ef7187cd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.528643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.529441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.529734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.530120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.531269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.532722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.537142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 103/200] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:55.537142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.538195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 98/201] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:55.541231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.571209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.664614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dbacd-3bd6-4941-b493-ddd95d45cff1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.666200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c422c9-3ea2-4aba-b7a0-edfa5f57f0a1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.675426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.706676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.707740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.708351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.708915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.710355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.712054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.714031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.714669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.714950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.715222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] PATH_INFO: `/v3/users/3e6413d2d540447caf7c1370a3f988ac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.717077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6413d2d540447caf7c1370a3f988ac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.719716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.719716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 104/202] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/users/3e6413d2d540447caf7c1370a3f988ac => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:55.721550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.721870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 99/203] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:55.723598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.827939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:55.840639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36b85e-e59a-4d71-97c2-61b51c990603 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.870747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27dca-3d2d-40e2-b4e2-06958362b946 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:55.879498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.880524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.881007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.881566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.882596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] RBAC: Adding query filter params (role.id=316f0e38f78f4eb09fca1ae4e603f5ab, scope.project.id=a6d401ac09b64a7a84d25278403a2720, user.id=fe87b5aee232481096ab93bb08d2a331) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:55.883123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.885481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.892347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 100/204] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/role_assignments?user.id=fe87b5aee232481096ab93bb08d2a331&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=316f0e38f78f4eb09fca1ae4e603f5ab => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:55.893696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:55.921237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:55.921237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:55.921237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:55.921237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:55.921962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=3e6413d2d540447caf7c1370a3f988ac) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:55.921962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:55.921962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:55.931522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 105/205] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/role_assignments?user.id=3e6413d2d540447caf7c1370a3f988ac&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:56.028837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cef8f-8f03-43f2-bc27-eaf0f79562c6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:56.072607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:56.073447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:56.073730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:56.074003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:56.121358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:56.181679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:56.183156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:56.299441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 101/206] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:08:56.307451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:56.352521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:56.424464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca0be5-f7b9-4c9a-9c05-8460e2cc9ac5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:56.465028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded6d57-82c0-4dd7-9d08-2386cdcca5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:56.465598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6d57-82c0-4dd7-9d08-2386cdcca5bc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:56.465875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6d57-82c0-4dd7-9d08-2386cdcca5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:56.466170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6d57-82c0-4dd7-9d08-2386cdcca5bc None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:56.467375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6d57-82c0-4dd7-9d08-2386cdcca5bc None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:56.468910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6d57-82c0-4dd7-9d08-2386cdcca5bc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:56.470624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 106/207] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:56 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:56.476504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:56.542879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:56.595519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba2c01-d059-492d-855f-ba84fbe377cb None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:56.633072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:56.633720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:56.633995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:56.634270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:56.635417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] RBAC: Adding query filter params (role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=3e6413d2d540447caf7c1370a3f988ac) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:56.635833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:56.637306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be730a55-3f35-4576-bad0-4c9d92ac504c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:56.643566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 102/208] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:56 2022] GET /identity/v3/role_assignments?user.id=3e6413d2d540447caf7c1370a3f988ac&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:57.021449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79840-1ad4-4547-80fb-34d69a58786e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.021996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79840-1ad4-4547-80fb-34d69a58786e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.021996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79840-1ad4-4547-80fb-34d69a58786e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.023847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 107/209] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:57.029719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.030174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.030524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.044857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c473-a7f9-40e0-bcf6-98bdf87ab9df None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.045494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c473-a7f9-40e0-bcf6-98bdf87ab9df None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.045992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c473-a7f9-40e0-bcf6-98bdf87ab9df None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.047621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 108/210] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:08:57.049982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:57.051193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:57.053359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.053752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.054127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.073671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:57.075083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:57.138105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 103/211] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:57.156627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 109/212] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:08:57.408930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:57.435783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:57.461838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:57.473865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:57.516941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaac047-c246-46ca-8528-7ee3588ec8bc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:57.547763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e2ea1-2996-4132-abf1-ff3b1ff881dd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:57.552256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:57.553025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.553442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.553821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.565929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:57.571476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:57.573089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:57.573951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 104/213] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:57.581160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:57.592324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:57.593221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.593666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.594098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.595355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:57.597014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:57.603376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 110/214] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:57.604512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:57.696288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffad254-e474-4c35-86a0-3710b04f9a0d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:57.719676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12766900-cc9f-46a3-b96d-87bc98c4e26f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:57.722463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:57.725149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:57.739639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:57.740751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.741212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.742061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.742893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:57.743343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:57.745326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:57.754740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 105/215] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:57.760275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:57.765464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:57.766472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.767011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.767547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.768464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:57.770901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:57.800923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 111/216] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:08:57 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:08:57.887932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c6824-ff5e-483e-b140-6d13c01fe818 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:57.930262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bfc69-9790-4b6f-ade3-adf9532ef4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:57.931327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bfc69-9790-4b6f-ade3-adf9532ef4bb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:57.932039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bfc69-9790-4b6f-ade3-adf9532ef4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:57.932579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bfc69-9790-4b6f-ade3-adf9532ef4bb None admin] PATH_INFO: `/v3/users/4aec25a1abd8449082ca254f8b9ea66f` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:57.950451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bfc69-9790-4b6f-ade3-adf9532ef4bb None admin] RBAC: Authorizing `identity:get_user(user_id=4aec25a1abd8449082ca254f8b9ea66f)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:57.951873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bfc69-9790-4b6f-ade3-adf9532ef4bb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:57.953669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 106/217] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:57 2022] GET /identity/v3/users/4aec25a1abd8449082ca254f8b9ea66f => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:08:57.959498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:58.045339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d985-afb0-4f34-8eef-6d776b106e29 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.045653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d985-afb0-4f34-8eef-6d776b106e29 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.046167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094d985-afb0-4f34-8eef-6d776b106e29 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.047499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 107/218] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:08:58.052771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c299c2-44ac-498c-8893-24702621a14d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.053055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c299c2-44ac-498c-8893-24702621a14d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.053357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c299c2-44ac-498c-8893-24702621a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.076331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43c299c2-44ac-498c-8893-24702621a14d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:58.077559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43c299c2-44ac-498c-8893-24702621a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:58.082590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18880903-f7ff-4883-9e3e-76243406b39a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:58.109430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:58.132866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:58.133541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.133824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.134099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.173181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:58.176708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 108/219] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:58.222642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:58.224058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:58.339581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 112/220] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:08:58.345496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c299c2-44ac-498c-8893-24702621a14d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:58.455368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c299c2-44ac-498c-8893-24702621a14d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:58.499713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:58.500722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.501275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.501763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.503105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:58.504762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:58.506653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 109/221] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:58 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:58.513077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:58.539614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:58.574120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:58.669473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:58.688485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369c04-57e6-487a-a9a1-c8f4e44a7c3d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:58.718827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc269a2-f764-43b6-b1b3-c62fcdf511b7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:58.730225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6f8a6-c110-4747-979a-3dd3cc1b3d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:58.731262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f8a6-c110-4747-979a-3dd3cc1b3d0d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.731554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f8a6-c110-4747-979a-3dd3cc1b3d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.731835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f8a6-c110-4747-979a-3dd3cc1b3d0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.745951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6f8a6-c110-4747-979a-3dd3cc1b3d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-91b6f8a6-c110-4747-979a-3dd3cc1b3d0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:58.753041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:58.753955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:08:58.754763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 110/222] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:08:58.761223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0ce5-380c-441c-8906-0bbca22b735f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.761223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0ce5-380c-441c-8906-0bbca22b735f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.761223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0ce5-380c-441c-8906-0bbca22b735f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.761223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 111/223] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:08:58.766072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a0ce5-380c-441c-8906-0bbca22b735f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:58.770948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:58.771579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.771863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.772142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.772875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=4aec25a1abd8449082ca254f8b9ea66f) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:58.773235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:58.774955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15381a6-40be-460c-a5b8-4f919f646a08 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:58.781893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 113/224] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:08:58 2022] GET /identity/v3/role_assignments?user.id=4aec25a1abd8449082ca254f8b9ea66f&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:58.783023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.783313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.783587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.802976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:08:58.804198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:08:58.876357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:58.896685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a0ce5-380c-441c-8906-0bbca22b735f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:58.953223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 114/225] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:08:58.963287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:58.964295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:58.964766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:58.965252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:58.966127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:58.966662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:58.968296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:58.986276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 112/226] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:58.993318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.058867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:59.116927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2cb2a-9cfe-402c-ae7e-5e6ea528eb5c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.158399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.159044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.159322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.159592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] PATH_INFO: `/v3/users/3e6413d2d540447caf7c1370a3f988ac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.160707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] RBAC: Authorizing `identity:get_user(user_id=3e6413d2d540447caf7c1370a3f988ac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.162255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.164138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 115/227] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:58 2022] GET /identity/v3/users/3e6413d2d540447caf7c1370a3f988ac => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:59.169677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.305373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f30a9-4192-47f1-a1e4-175fc0a1c6a3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.321280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.355798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.357872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.358558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.359717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.363865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.365618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.373679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 113/228] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:08:59 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:59.376090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.411232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:59.494114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d714c0-0fd3-47cc-907b-4d07a60e9b5b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.518732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:59.542731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.543730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.544214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.544681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.564343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:08:59.571533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:08:59.572423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:08:59.573238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:08:59.580275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 116/229] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:08:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:08:59.593383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.594026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badd908-0097-4c46-a1de-5df7b1ba3092 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.662401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.663093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.663380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.663663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/3e6413d2d540447caf7c1370a3f988ac/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.670434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ee96b1a5b843d9be5325d726a95585, user_id=3e6413d2d540447caf7c1370a3f988ac, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.671910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.694975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 114/230] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:08:59 2022] PUT /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/3e6413d2d540447caf7c1370a3f988ac/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:08:59.724704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62a94-c3b2-498d-94fe-7a3e92ffdbba None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:08:59.783356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:08:59.784365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:08:59.784868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:08:59.785368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:08:59.786336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:08:59.786852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:08:59.788441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:08:59.803301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 117/231] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:08:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:08:59.809519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:08:59.930986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:08:59.958856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673068f-f369-4ad3-ad49-ceedbd728532 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:00.004618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cbe08-aaa8-4d02-a27a-852f7c334461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:00.005713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cbe08-aaa8-4d02-a27a-852f7c334461 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.006196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cbe08-aaa8-4d02-a27a-852f7c334461 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.006669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cbe08-aaa8-4d02-a27a-852f7c334461 None admin] PATH_INFO: `/v3/users/3e6413d2d540447caf7c1370a3f988ac` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.008033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cbe08-aaa8-4d02-a27a-852f7c334461 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6413d2d540447caf7c1370a3f988ac)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:00.009798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cbe08-aaa8-4d02-a27a-852f7c334461 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:00.012218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 115/232] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:08:59 2022] GET /identity/v3/users/3e6413d2d540447caf7c1370a3f988ac => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:00.018034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:00.068565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:00.129064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119671c8-fb28-4a95-a120-fedf1f2b1657 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:00.164999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:00.166578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.167061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.167532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.168877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:00.170649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:00.172827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 118/233] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:00 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:00.178894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd1cb-3cc3-4d19-9827-46355bc70563 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.179421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd1cb-3cc3-4d19-9827-46355bc70563 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.179896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbd1cb-3cc3-4d19-9827-46355bc70563 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.181604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 116/234] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:00.182639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:00.189054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9d9a0-cf5c-46f1-8ecc-2e32013b6468 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.189367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9d9a0-cf5c-46f1-8ecc-2e32013b6468 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.189644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9d9a0-cf5c-46f1-8ecc-2e32013b6468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.230093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f1a9d9a0-cf5c-46f1-8ecc-2e32013b6468 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:00.231288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f1a9d9a0-cf5c-46f1-8ecc-2e32013b6468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:00.296339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f34c4-305b-42b4-96d2-2e9a00d0d4e5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:00.319239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:00.337028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb4731-3fad-4950-b165-29c409454728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:00.339160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4731-3fad-4950-b165-29c409454728 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.339926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4731-3fad-4950-b165-29c409454728 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.340463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb4731-3fad-4950-b165-29c409454728 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/3e6413d2d540447caf7c1370a3f988ac/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.343016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4731-3fad-4950-b165-29c409454728 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ee96b1a5b843d9be5325d726a95585, user_id=3e6413d2d540447caf7c1370a3f988ac, role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:00.344695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb4731-3fad-4950-b165-29c409454728 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:00.363221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 119/235] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:00 2022] PUT /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/3e6413d2d540447caf7c1370a3f988ac/roles/735d69de30e14d03a5a17f594ad42f5a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:09:00.406622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 117/236] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:00.446200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c833bc4-853a-440c-9b9d-32b98cce8839 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.446814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c833bc4-853a-440c-9b9d-32b98cce8839 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.447339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c833bc4-853a-440c-9b9d-32b98cce8839 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.449046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 120/237] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:00.455008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.455298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.455579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.475570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:00.476786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:00.563684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 118/238] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:00.754992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c833bc4-853a-440c-9b9d-32b98cce8839 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:00.894722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c833bc4-853a-440c-9b9d-32b98cce8839 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:00.936027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:00.937046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:00.937550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:00.938030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:00.949289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:00.954397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:00.955223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:00.956009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:00.958547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 121/239] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:00.965271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:00.974237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:00.999721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:01.061162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:01.164189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f957-ab45-448a-a3b0-0d6d0003b0c0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:01.205474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88097314-d0f8-4f63-9f40-9c4240e66861 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:01.233237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:01.233853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.234128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.234397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.235060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:01.235357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:01.236725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:01.256471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 119/240] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:01.264275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:01.282666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:01.283303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.283582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.283852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.286604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:01.288061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:01.289650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 122/241] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:01.296107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:01.368216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:01.391310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da14d0-07de-4d43-8d1a-971f4df7326a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:01.407428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:01.410845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74042c52-d120-4b9b-95fe-ec14a6bb9d69 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:01.430218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466632-3893-4973-9d97-a42b260d523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:01.430951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466632-3893-4973-9d97-a42b260d523d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.431232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466632-3893-4973-9d97-a42b260d523d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.431528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466632-3893-4973-9d97-a42b260d523d None admin] PATH_INFO: `/v3/users/6abfc214b49b459a954891d0794cf585` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.446624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466632-3893-4973-9d97-a42b260d523d None admin] RBAC: Authorizing `identity:get_user(user_id=6abfc214b49b459a954891d0794cf585)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:01.448124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466632-3893-4973-9d97-a42b260d523d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:01.448452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de259968-4023-4be4-a1f7-831d88f9c21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:01.449072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259968-4023-4be4-a1f7-831d88f9c21f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.449382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259968-4023-4be4-a1f7-831d88f9c21f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.449656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de259968-4023-4be4-a1f7-831d88f9c21f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.450102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 120/242] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:01 2022] GET /identity/v3/users/6abfc214b49b459a954891d0794cf585 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:01.450308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de259968-4023-4be4-a1f7-831d88f9c21f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:01.451343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc5c67-b822-4e1f-b50c-77783d479766 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.451623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc5c67-b822-4e1f-b50c-77783d479766 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.451788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de259968-4023-4be4-a1f7-831d88f9c21f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:01.451879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc5c67-b822-4e1f-b50c-77783d479766 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.453241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 121/243] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:01.462059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc5c67-b822-4e1f-b50c-77783d479766 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:01.481630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 123/244] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:01 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:09:01.482994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.483289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.483619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.505649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:01.507025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:01.595486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 124/245] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:01.626021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc5c67-b822-4e1f-b50c-77783d479766 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:01.677061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:01.699590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:01.700237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:01.700512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:01.700779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:01.788840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:01.790332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:01.893818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 122/246] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:01.899546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:01.956064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:01.991057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:02.006261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:02.027066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e644ef-ec13-4cdd-a309-50911342c03b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.070000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:02.070799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.071712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.071997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.073276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:02.075195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:02.077475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 125/247] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:01 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:02.083387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:02.091794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a435e-4851-40c8-9119-7442b1df8b88 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.131551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:02.132121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.132404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.132676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.144100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:02.149051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:02.150230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:02.151559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 123/248] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:02.157914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:02.225164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f11a-6bae-4087-948d-2112391c8769 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.257531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:02.271264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005b61-63be-43ea-a644-293143fc0d81 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.278265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:02.278892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.279181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.279477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.280312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] RBAC: Adding query filter params (role.id=316f0e38f78f4eb09fca1ae4e603f5ab, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=6abfc214b49b459a954891d0794cf585) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:02.280623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:02.282758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e756bde-e39b-4819-b22d-64c880dc36b9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:02.292408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 126/249] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:02 2022] GET /identity/v3/role_assignments?user.id=6abfc214b49b459a954891d0794cf585&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=316f0e38f78f4eb09fca1ae4e603f5ab => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:02.294289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f16a-f1dc-45d2-84f5-4d9e3d8a3f40 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.294606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f16a-f1dc-45d2-84f5-4d9e3d8a3f40 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.294869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f16a-f1dc-45d2-84f5-4d9e3d8a3f40 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.296939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 127/250] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:02.303181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.303507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.303749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.319643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:02.320264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.320542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.320812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.321582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:02.321886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:02.324037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:02.328152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:02.329428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:02.334165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 124/251] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:02.340314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:02.359435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:02.423923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 128/252] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:02.507052 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e4354-472a-4c28-8204-287cde41cd7c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.545801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:02.546451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.546733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.547012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] PATH_INFO: `/v3/users/4aec25a1abd8449082ca254f8b9ea66f` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.548160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] RBAC: Authorizing `identity:get_user(user_id=4aec25a1abd8449082ca254f8b9ea66f)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:02.549700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:02.551668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 125/253] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:02 2022] GET /identity/v3/users/4aec25a1abd8449082ca254f8b9ea66f => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:02.557538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:02.694225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b375720-81b1-48c7-8e3b-58edabb6e5b3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.746053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:02.747082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:02.747564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:02.748059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:02.749429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:02.751098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:02.752950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 129/254] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:02 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:02.758737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:02.763926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:02.793491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:02.794680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:02.950027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002282ba-165f-434d-ae35-ef8281e9e886 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:02.983603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbab7a-e404-4bc3-b7d0-0e0251459a43 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:03.022439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6122dc-43b4-427f-a202-cf79c329f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:03.023109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6122dc-43b4-427f-a202-cf79c329f446 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.023389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6122dc-43b4-427f-a202-cf79c329f446 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.023662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6122dc-43b4-427f-a202-cf79c329f446 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/4aec25a1abd8449082ca254f8b9ea66f/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.027626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6122dc-43b4-427f-a202-cf79c329f446 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ee96b1a5b843d9be5325d726a95585, user_id=4aec25a1abd8449082ca254f8b9ea66f, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:03.031478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6122dc-43b4-427f-a202-cf79c329f446 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:03.045206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:03.048497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.048838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.049131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.053786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 126/255] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:02 2022] PUT /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/4aec25a1abd8449082ca254f8b9ea66f/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:03.054811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90360e-9626-4e16-a106-3c55568fcd8d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.056323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90360e-9626-4e16-a106-3c55568fcd8d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.058665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90360e-9626-4e16-a106-3c55568fcd8d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.062407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 127/256] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:03.068136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.068416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.068804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.079444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:03.091466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:03.092848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:03.093685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:03.094296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 130/257] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:03.099837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:03.107859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:03.112683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:03.209396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:03.237239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24d9e0-9a73-498d-9fdd-a2ea799a4b0d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:03.280121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:03.281219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.281650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.282070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.282904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:03.283505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:03.285162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:03.302178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 131/258] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:03.308335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:03.330452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 128/259] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:03.416663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32bd5-898a-4f4b-9687-733bdd10f47c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:03.452096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:03.452976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.453463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.453881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] PATH_INFO: `/v3/users/3e6413d2d540447caf7c1370a3f988ac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.455157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6413d2d540447caf7c1370a3f988ac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:03.456769 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:03.458832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 132/260] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:03 2022] GET /identity/v3/users/3e6413d2d540447caf7c1370a3f988ac => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:03.464951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:03.468844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:03.583320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004c03-ab28-4839-a805-3df0dd263c2f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:03.633767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619badf6-f072-4923-aff3-116591f35693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:03.634398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619badf6-f072-4923-aff3-116591f35693 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:03.634898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619badf6-f072-4923-aff3-116591f35693 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:03.635231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619badf6-f072-4923-aff3-116591f35693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:03.713318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619badf6-f072-4923-aff3-116591f35693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:03.715776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619badf6-f072-4923-aff3-116591f35693 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:03.722680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:03.837323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 129/261] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:03.840139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:03.865455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:03.880290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619badf6-f072-4923-aff3-116591f35693 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:04.040418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829ba03-7b8a-4655-bafc-42cb241d5466 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:04.095990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619badf6-f072-4923-aff3-116591f35693 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:04.098469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:04.100095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:04.101045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.101569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.102044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.104702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:04.107291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:04.109460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 133/262] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:03 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:04.115489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:04.165162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:04.165366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.165735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.166447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.185505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:04.190681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:04.191636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:04.192810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 130/263] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:04.200849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:04.251210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:04.315319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad99e-f9fb-4c75-8d4e-a67e89a8a852 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:04.339037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf1e15-1fbf-41d6-9d04-691f59a6e30d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:04.376655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:04.377311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.377595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.377870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.378546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:04.378852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:04.380254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:04.389717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 131/264] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:04.394884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:04.412704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:04.413350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.413630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.413905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.414635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=3e6413d2d540447caf7c1370a3f988ac) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:04.414938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:04.416636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:04.426095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:04.435438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 134/265] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:04 2022] GET /identity/v3/role_assignments?user.id=3e6413d2d540447caf7c1370a3f988ac&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:04.505916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af18ea-f4e8-4738-ac74-4a1639870924 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:04.543692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3015b-6718-4c7c-a082-a74e521059f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:04.544337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3015b-6718-4c7c-a082-a74e521059f8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.544617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3015b-6718-4c7c-a082-a74e521059f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.544893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3015b-6718-4c7c-a082-a74e521059f8 None admin] PATH_INFO: `/v3/users/3e6413d2d540447caf7c1370a3f988ac` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.546330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3015b-6718-4c7c-a082-a74e521059f8 None admin] RBAC: Authorizing `identity:get_user(user_id=3e6413d2d540447caf7c1370a3f988ac)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:04.547686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3015b-6718-4c7c-a082-a74e521059f8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:04.550107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 132/266] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:04 2022] GET /identity/v3/users/3e6413d2d540447caf7c1370a3f988ac => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:04.554905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:04.715878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bb3c7-651d-4f27-96a8-cd6ba39bfe1b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:04.768565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ada79d-8bdc-40f5-9010-fe65eb81f47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:04.769212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ada79d-8bdc-40f5-9010-fe65eb81f47c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.769497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ada79d-8bdc-40f5-9010-fe65eb81f47c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.769770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ada79d-8bdc-40f5-9010-fe65eb81f47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.781475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:04.861786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ada79d-8bdc-40f5-9010-fe65eb81f47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:04.863627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ada79d-8bdc-40f5-9010-fe65eb81f47c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:04.923956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e70fd-1cfa-4ccc-8050-7b01bf3690ca None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.924138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e70fd-1cfa-4ccc-8050-7b01bf3690ca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.924426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e70fd-1cfa-4ccc-8050-7b01bf3690ca None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.926040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 133/267] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:09:04.937978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909a3c7-0d9b-45a5-9c77-f74536c5892f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:04.938839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909a3c7-0d9b-45a5-9c77-f74536c5892f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:04.939470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909a3c7-0d9b-45a5-9c77-f74536c5892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:04.964534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f909a3c7-0d9b-45a5-9c77-f74536c5892f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:04.968397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f909a3c7-0d9b-45a5-9c77-f74536c5892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:05.028367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 135/268] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:05.030441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4d74-d7cc-40c2-b484-919a6eeb6b15 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.030942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4d74-d7cc-40c2-b484-919a6eeb6b15 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.031444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a4d74-d7cc-40c2-b484-919a6eeb6b15 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.033505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 136/269] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:05.034420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4d74-d7cc-40c2-b484-919a6eeb6b15 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.069775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 134/270] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:05.078492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8f6a-2a54-479f-9854-bbd31274ba0b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.078777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8f6a-2a54-479f-9854-bbd31274ba0b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.079050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8f6a-2a54-479f-9854-bbd31274ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.088278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.106205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-34cd8f6a-2a54-479f-9854-bbd31274ba0b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:05.108048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-34cd8f6a-2a54-479f-9854-bbd31274ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:05.138787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.164873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a4d74-d7cc-40c2-b484-919a6eeb6b15 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.206405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.207436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.207923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.208418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.209777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:05.211753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:05.214219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 137/271] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:05.220135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.270524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 135/272] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:05.272146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00920b-ab8a-460e-bdb6-cc2e86d74dd4 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.272607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00920b-ab8a-460e-bdb6-cc2e86d74dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.273057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00920b-ab8a-460e-bdb6-cc2e86d74dd4 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.274789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 136/273] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:05.280475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.280974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.281444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.311233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:05.312745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:05.340804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66563719-8b27-4d68-bcb6-d2ecb285d6b3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.349760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.382082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.383076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.383505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.384166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.386454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] RBAC: Adding query filter params (role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=3e6413d2d540447caf7c1370a3f988ac) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:05.386964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:05.388763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:05.396471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 138/274] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/role_assignments?user.id=3e6413d2d540447caf7c1370a3f988ac&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:05.435321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.459633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 137/275] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:05.564581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce292b80-6778-4ef1-98b5-90542f97b947 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.624277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.624898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.625635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.625919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.626187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.646252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:05.653251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:05.654323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:05.655274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 139/276] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:05.660443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.709335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.735400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.756475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a83e4-5df3-473f-8918-5f59415cf3e4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.799093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcb764-c95b-4ccf-aead-e8afbbc79ca8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.802390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.803235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.803716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.804216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.819542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:05.825926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:05.826974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:05.827981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 138/277] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:05.828745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.855852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.856462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.856743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.857017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.857722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:05.858025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:05.859466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:05.868588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 140/278] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:05.870300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.936898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f64e2d-7124-4c20-b8ac-45cea00d8e60 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.965272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:05.972505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe8fbd-2f4d-4ca5-af60-4ce1aabe27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:05.973175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe8fbd-2f4d-4ca5-af60-4ce1aabe27cd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.973483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe8fbd-2f4d-4ca5-af60-4ce1aabe27cd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.973890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe8fbd-2f4d-4ca5-af60-4ce1aabe27cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.974698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161c2cb-713d-4fa3-b0b8-04e4eb4ddf04 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:05.974949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe8fbd-2f4d-4ca5-af60-4ce1aabe27cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:05.976390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe8fbd-2f4d-4ca5-af60-4ce1aabe27cd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:05.977984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 139/279] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:05.979633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550be3-b77d-4e3a-b9d6-9b4fee0ab21f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:05.979915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550be3-b77d-4e3a-b9d6-9b4fee0ab21f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:05.980192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550be3-b77d-4e3a-b9d6-9b4fee0ab21f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:05.981575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 140/280] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:05.982181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550be3-b77d-4e3a-b9d6-9b4fee0ab21f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:05.997256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.012848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.013485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.013764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.014027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.014955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:06.015059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.016361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.029750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 141/281] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:06.029750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.090753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550be3-b77d-4e3a-b9d6-9b4fee0ab21f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.124405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4a3d1-ccc2-46fb-be78-4396a0d093bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.125038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a3d1-ccc2-46fb-be78-4396a0d093bd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.125322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a3d1-ccc2-46fb-be78-4396a0d093bd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.125595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4a3d1-ccc2-46fb-be78-4396a0d093bd None admin] PATH_INFO: `/v3/users/6abfc214b49b459a954891d0794cf585` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.125749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2b1d7-1139-4432-a62c-7dd93bf8e324 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.126691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4a3d1-ccc2-46fb-be78-4396a0d093bd None admin] RBAC: Authorizing `identity:get_user(user_id=6abfc214b49b459a954891d0794cf585)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.128262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4a3d1-ccc2-46fb-be78-4396a0d093bd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.129948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 141/282] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:05 2022] GET /identity/v3/users/6abfc214b49b459a954891d0794cf585 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:06.131045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.131325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.131599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.148719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:06.150220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:06.164966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.165613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.166431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.166700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.167341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.168771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.189911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 142/283] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:06 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:06.190982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.215377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.228863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 142/284] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:06.234446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.250810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.327016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb43aa-c3e7-4df1-a7ff-a0fd98a2cd3f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.359373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc430f9-0b8b-4f76-b40c-37e57a63ceaa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.364311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.364950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.367024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.367024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] PATH_INFO: `/v3/users/1cddedc3c34c45088c1f470d3dad009a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.386416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] RBAC: Authorizing `identity:get_user(user_id=1cddedc3c34c45088c1f470d3dad009a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.388120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.390262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 143/285] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:06 2022] GET /identity/v3/users/1cddedc3c34c45088c1f470d3dad009a => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:06.398445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.401232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.401932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.402216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.402488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.405721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.407186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.409146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 143/286] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:06 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:06.414382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.480621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.521843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.522891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cf2e7-dd68-4855-ab8f-8a57e850e000 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.549004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6c078-af8d-403c-bf4a-176e784793f1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.567185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.567802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.568908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.569208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.569938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, user.id=1cddedc3c34c45088c1f470d3dad009a, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:06.570255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.572565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.579997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 144/287] 10.222.0.88 () {56 vars in 1308 bytes} [Mon Aug 29 23:09:06 2022] GET /identity/v3/role_assignments?user.id=1cddedc3c34c45088c1f470d3dad009a&scope.system=all&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:06.581235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.596051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.597167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.597623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.598069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/6abfc214b49b459a954891d0794cf585/roles/316f0e38f78f4eb09fca1ae4e603f5ab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.601622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ee96b1a5b843d9be5325d726a95585, user_id=6abfc214b49b459a954891d0794cf585, role_id=316f0e38f78f4eb09fca1ae4e603f5ab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.603411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.631671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 144/288] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:06 2022] PUT /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585/users/6abfc214b49b459a954891d0794cf585/roles/316f0e38f78f4eb09fca1ae4e603f5ab => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:09:06.724111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3aac-01b5-44d5-8063-ef887a118648 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.767106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:06.777485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.778082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.778365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.778646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.792791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:06.799057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:06.800018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:06.800789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 145/289] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:06.814313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:06.940182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81430a3e-c31d-47a5-a4b9-255ed1c95f14 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:06.980056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:06.980735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:06.981015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:06.981356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:06.982034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:06.982333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:06.983723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:06.992352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:07.000337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 145/290] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:07.005899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:07.123900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868ef61-fe5f-4917-9e99-1b93ce365430 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:07.159612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:07.160256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:07.160542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:07.160819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] PATH_INFO: `/v3/users/4aec25a1abd8449082ca254f8b9ea66f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:07.161994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] RBAC: Authorizing `identity:get_user(user_id=4aec25a1abd8449082ca254f8b9ea66f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:07.163451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:07.165368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 146/291] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:07 2022] GET /identity/v3/users/4aec25a1abd8449082ca254f8b9ea66f => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:07.171835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:07.305564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544b9a-eae9-4922-b1d5-c36ce74fd9f9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:07.342161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:07.342770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:07.343056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:07.343317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:07.409492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:07.417558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:07.419056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:07.544220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 146/292] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:07.550608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:07.613366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:07.685173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17133df-27e5-430b-baa5-4e4a0191e284 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:07.737807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570132d-a3f0-4a69-aaab-59ca617fa9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:07.738449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570132d-a3f0-4a69-aaab-59ca617fa9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:07.738733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570132d-a3f0-4a69-aaab-59ca617fa9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:07.739009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570132d-a3f0-4a69-aaab-59ca617fa9f4 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:07.740164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570132d-a3f0-4a69-aaab-59ca617fa9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:07.741646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570132d-a3f0-4a69-aaab-59ca617fa9f4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:07.743433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 147/293] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:07 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:07.749793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:07.890369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e9aa2-cd07-4af8-9ec2-450256cf2437 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:07.893447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:07.937987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:07.938528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:07.938807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:07.939079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:07.939813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=4aec25a1abd8449082ca254f8b9ea66f) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:07.940184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:07.941652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa09e1-fe9c-4968-a4e5-9b139a4ecc53 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:07.948417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 147/294] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:07 2022] GET /identity/v3/role_assignments?user.id=4aec25a1abd8449082ca254f8b9ea66f&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:08.582738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daeeda-3594-48c8-867d-0ce44c26e452 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.583246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daeeda-3594-48c8-867d-0ce44c26e452 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.583321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daeeda-3594-48c8-867d-0ce44c26e452 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.584670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 148/295] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:08.594304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c319-4602-43c8-ae36-0e0442d70199 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.594782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c319-4602-43c8-ae36-0e0442d70199 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.594878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97c319-4602-43c8-ae36-0e0442d70199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.621435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ac97c319-4602-43c8-ae36-0e0442d70199 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:08.622912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ac97c319-4602-43c8-ae36-0e0442d70199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:08.710834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 148/296] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:08.872537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291d12e-8eeb-4f0e-a082-c09ab3eda439 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.872918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291d12e-8eeb-4f0e-a082-c09ab3eda439 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.873414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291d12e-8eeb-4f0e-a082-c09ab3eda439 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.875649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 149/297] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:08.881571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.881862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.882144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.902673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:08.903866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:08.926031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab7d54-05d7-4576-aefc-6c2cabaee51a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.926031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab7d54-05d7-4576-aefc-6c2cabaee51a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.926031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab7d54-05d7-4576-aefc-6c2cabaee51a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.926031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 150/298] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:08.932107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:08.932688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:08.933191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:08.953585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:08.955122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:09.000182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 149/299] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:09.026467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.049220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 151/300] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:09.054130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.135543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4c1b-ece2-448b-a101-75ed034119c7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.173141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.173791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.174367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.174644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.185979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:09.191280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:09.192166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:09.193159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 150/301] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:09.202840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.273563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.305500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.324039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444e57-e947-4f28-af3f-6be03d714347 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.365242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.365871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.366153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.366426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.367135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:09.367438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:09.368829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:09.378317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 152/302] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:09.379451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.404877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.421848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d2a8c-15bc-4b55-bf1a-895fd44df1be None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.462872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.463506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.463784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.464051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.474149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:09.479023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:09.479928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:09.480711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 151/303] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:09.481881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.501312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47de118-1d75-40cd-84df-c7f187aadb40 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.521479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.536642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d46951-e770-41a5-b1a6-0318513f4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.537318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46951-e770-41a5-b1a6-0318513f4ddc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.537600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46951-e770-41a5-b1a6-0318513f4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.537878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d46951-e770-41a5-b1a6-0318513f4ddc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.538987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d46951-e770-41a5-b1a6-0318513f4ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:09.540467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d46951-e770-41a5-b1a6-0318513f4ddc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:09.542387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 153/304] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:09.543665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d40a-c45b-448f-9042-7b503ae73823 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.543949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d40a-c45b-448f-9042-7b503ae73823 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.544225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d40a-c45b-448f-9042-7b503ae73823 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.545724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 154/305] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:09.546333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d40a-c45b-448f-9042-7b503ae73823 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.586831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee1271-b960-4965-9941-9b71280777ce None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.622987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.623457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.623457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.623694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] PATH_INFO: `/v3/users/aff2faa7f2d14472bb70ce05d3940394` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.637720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=aff2faa7f2d14472bb70ce05d3940394)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:09.639198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:09.640843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 152/306] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/users/aff2faa7f2d14472bb70ce05d3940394 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:09.645984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.645984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.657463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d40a-c45b-448f-9042-7b503ae73823 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.713811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.714850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.715373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.715864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.717102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:09.717513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:09.718916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2514-79fc-4f2b-bc43-a9260b816c33 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:09.727328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 155/307] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:09.728726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.729337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.729570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.741910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6f14b-5baa-4aba-810b-913586224ab6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.748415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:09.750528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:09.776827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.777482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.777762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.778034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] PATH_INFO: `/v3/groups` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.778663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:09.780101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:09.795813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 153/308] 10.222.0.88 () {60 vars in 1134 bytes} [Mon Aug 29 23:09:09 2022] POST /identity/v3/groups => generated 229 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:09.796639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.812360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.837817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 156/309] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:09.839732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:09.875174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:09.923613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb491a-5aef-42be-be39-ef356fcdd433 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:09.961947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:09.962557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:09.963244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:09.963349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:09.964274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] RBAC: Adding query filter params (role.id=316f0e38f78f4eb09fca1ae4e603f5ab, user.id=aff2faa7f2d14472bb70ce05d3940394, scope.system=all) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:09.964585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:09.966128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:09.973178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 154/310] 10.222.0.88 () {56 vars in 1308 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/role_assignments?user.id=aff2faa7f2d14472bb70ce05d3940394&scope.system=all&role.id=316f0e38f78f4eb09fca1ae4e603f5ab => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:09.977263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e96892-0465-4334-8adc-b6912341b5fd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:10.017688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:10.018344 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:10.018625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:10.018899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] PATH_INFO: `/v3/users/1cddedc3c34c45088c1f470d3dad009a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:10.020055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] RBAC: Authorizing `identity:get_user(user_id=1cddedc3c34c45088c1f470d3dad009a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:10.021553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:10.023589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 157/311] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:09 2022] GET /identity/v3/users/1cddedc3c34c45088c1f470d3dad009a => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:10.030297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:10.112423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:10.157919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f22f90-f5da-4d23-b406-81f97f50d501 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:10.180419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:10.187724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:10.197765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:10.198917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:10.199491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:10.200006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] PATH_INFO: `/v3/system/users/1cddedc3c34c45088c1f470d3dad009a/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:10.201715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1cddedc3c34c45088c1f470d3dad009a, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:10.203459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:10.213737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 155/312] 10.222.0.88 () {58 vars in 1334 bytes} [Mon Aug 29 23:09:10 2022] PUT /identity/v3/system/users/1cddedc3c34c45088c1f470d3dad009a/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:10.250624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4379c2-da33-44ad-b3f1-27ec7ef730db None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:10.289726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:10.290401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:10.290654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:10.291608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:10.304161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:10.309762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:10.310720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:10.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 158/313] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:10.317142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:10.434903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10352c-1063-49b9-82ca-b2a6c4a645f5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:10.477959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:10.479269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:10.479754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:10.480264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:10.481150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:10.481668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:10.483357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:10.492695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 156/314] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:10.498699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:10.601984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e55ca6-5981-44ab-8900-c8d1db05f257 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:10.612316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:10.638476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:10.639117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:10.639398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:10.639674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] PATH_INFO: `/v3/users/6abfc214b49b459a954891d0794cf585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:10.640801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] RBAC: Authorizing `identity:get_user(user_id=6abfc214b49b459a954891d0794cf585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:10.642309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:10.644184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 159/315] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:10 2022] GET /identity/v3/users/6abfc214b49b459a954891d0794cf585 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:10.650215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:10.707155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:10.758999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eecc0-0124-4983-828b-6140e783996d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:10.795297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:10.795982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:10.796264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:10.796540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:10.866642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:10.868133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:10.922848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:10.975786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 157/316] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:10.981504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:11.086577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab59e-bb3a-426d-850b-5204b84afadc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:11.123071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868eb30-7cd5-4614-a639-46bcbd18df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:11.123713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868eb30-7cd5-4614-a639-46bcbd18df80 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:11.123994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868eb30-7cd5-4614-a639-46bcbd18df80 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:11.124270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868eb30-7cd5-4614-a639-46bcbd18df80 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:11.125415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868eb30-7cd5-4614-a639-46bcbd18df80 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:11.126887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868eb30-7cd5-4614-a639-46bcbd18df80 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:11.128805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 160/317] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:10 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:11.134740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:11.238057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615457e5-481b-48f6-8318-48bdaddcdccc None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:11.274305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:11.275214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:11.275513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:11.275783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:11.276513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] RBAC: Adding query filter params (role.id=316f0e38f78f4eb09fca1ae4e603f5ab, scope.project.id=d5ee96b1a5b843d9be5325d726a95585, user.id=6abfc214b49b459a954891d0794cf585) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:11.276818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:11.278292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe7cca-e69e-4fb5-84d0-f242fbab79ed None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:11.284799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 158/318] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:11 2022] GET /identity/v3/role_assignments?user.id=6abfc214b49b459a954891d0794cf585&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=316f0e38f78f4eb09fca1ae4e603f5ab => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:11.834808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0ef1-8c8c-49f2-90c7-2ba8f4118313 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:11.835205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0ef1-8c8c-49f2-90c7-2ba8f4118313 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:11.835425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0ef1-8c8c-49f2-90c7-2ba8f4118313 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:11.836821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 161/319] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:11.842476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978477fb-3581-4c6d-8afc-ac20f93d3bb9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:11.842925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978477fb-3581-4c6d-8afc-ac20f93d3bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:11.843025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978477fb-3581-4c6d-8afc-ac20f93d3bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:11.861932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-978477fb-3581-4c6d-8afc-ac20f93d3bb9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:11.863109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-978477fb-3581-4c6d-8afc-ac20f93d3bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:11.875408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:11.934103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 159/320] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:11.981593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823d02-2cd0-40ce-9c73-d3e0d4db82f9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:11.982122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823d02-2cd0-40ce-9c73-d3e0d4db82f9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:11.982122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823d02-2cd0-40ce-9c73-d3e0d4db82f9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:11.983600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 162/321] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:11.988707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62b20-49af-49c4-a54d-bea0251f6246 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:11.989003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62b20-49af-49c4-a54d-bea0251f6246 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:11.989312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c62b20-49af-49c4-a54d-bea0251f6246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.008027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b8c62b20-49af-49c4-a54d-bea0251f6246 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:12.009245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b8c62b20-49af-49c4-a54d-bea0251f6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:12.076691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 160/322] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:12.201831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823d02-2cd0-40ce-9c73-d3e0d4db82f9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.250278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:12.254074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03919eec-5980-4d5a-a4e0-4794f77b84ae None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.254355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03919eec-5980-4d5a-a4e0-4794f77b84ae None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.254625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03919eec-5980-4d5a-a4e0-4794f77b84ae None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.255965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 161/323] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:12.261518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13876c-8609-418d-a268-643396227d58 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.261800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13876c-8609-418d-a268-643396227d58 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.262073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13876c-8609-418d-a268-643396227d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.280916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0c13876c-8609-418d-a268-643396227d58 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:12.282140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c13876c-8609-418d-a268-643396227d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:12.316093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823d02-2cd0-40ce-9c73-d3e0d4db82f9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:12.349469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:12.350099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.350372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.350642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.351713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:12.353156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:12.355221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 163/324] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:12.356653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 162/325] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:12.357981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.360485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13876c-8609-418d-a268-643396227d58 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.368333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:12.464431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3de73f-8359-4384-892a-88759c18efe9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:12.464604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13876c-8609-418d-a268-643396227d58 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:12.477933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:12.502248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:12.503111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.503564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.503936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:12.504147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.504539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.504814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.505082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] PATH_INFO: `/v3/groups` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.505731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:12.507167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:12.516767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:12.522121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:12.523056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:12.523875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:12.524741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 164/326] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:12.531743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.535104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 163/327] 10.222.0.88 () {60 vars in 1134 bytes} [Mon Aug 29 23:09:12 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:09:12.634146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.650742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c06ea-270f-4a72-86aa-83a1ffc8bb54 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:12.691841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:12.692825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.693190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.693476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.694148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:12.694455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:12.695830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:12.705391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 165/328] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:12.710958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.714835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:12.749880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:12.762808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2217f2-aff2-4858-b660-1c17decad24a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:12.809823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:12.810469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.810754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.811024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.822153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:12.829241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:12.830203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:12.830984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:12.833712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 164/329] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:12.840776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.843643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18304c-f7fb-4fb4-a77a-5f3bfd26ee5f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:12.886438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:12.887094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:12.887376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:12.887652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] PATH_INFO: `/v3/users/aff2faa7f2d14472bb70ce05d3940394` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:12.888920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] RBAC: Authorizing `identity:get_user(user_id=aff2faa7f2d14472bb70ce05d3940394)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:12.890571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:12.896860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 166/330] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:12 2022] GET /identity/v3/users/aff2faa7f2d14472bb70ce05d3940394 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:12.897914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:12.972034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a07bb-0557-47f0-84c6-501642158d1d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:13.006951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:13.020523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:13.021474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:13.021968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:13.022424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:13.023279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:13.023762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:13.025032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8c8b3-205e-4267-9697-681d98c5d5dd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:13.026856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:13.027402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:13.037864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 165/331] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:13.044511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:13.075267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:13.076281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:13.076571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:13.076847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] PATH_INFO: `/v3/system/users/aff2faa7f2d14472bb70ce05d3940394/roles/316f0e38f78f4eb09fca1ae4e603f5ab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:13.078712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aff2faa7f2d14472bb70ce05d3940394, role_id=316f0e38f78f4eb09fca1ae4e603f5ab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:13.080285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:13.093166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 167/332] 10.222.0.88 () {58 vars in 1334 bytes} [Mon Aug 29 23:09:12 2022] PUT /identity/v3/system/users/aff2faa7f2d14472bb70ce05d3940394/roles/316f0e38f78f4eb09fca1ae4e603f5ab => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:09:13.173566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563cdc-b136-4249-bef3-7130f5d9673a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:13.215513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76481c-0791-4a3e-8ab2-fa8dde4f7d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:13.216534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76481c-0791-4a3e-8ab2-fa8dde4f7d48 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:13.217154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76481c-0791-4a3e-8ab2-fa8dde4f7d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:13.217658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76481c-0791-4a3e-8ab2-fa8dde4f7d48 None admin] PATH_INFO: `/v3/users/1cddedc3c34c45088c1f470d3dad009a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:13.219200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76481c-0791-4a3e-8ab2-fa8dde4f7d48 None admin] RBAC: Authorizing `identity:get_user(user_id=1cddedc3c34c45088c1f470d3dad009a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:13.220919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76481c-0791-4a3e-8ab2-fa8dde4f7d48 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:13.223239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 166/333] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:13 2022] GET /identity/v3/users/1cddedc3c34c45088c1f470d3dad009a => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:13.231917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:13.352133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872c256-c2e6-473e-a1cb-96e3b75b8dbb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:13.392397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:13.393091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:13.393402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:13.393681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:13.394425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] RBAC: Adding query filter params (role.id=d3a9964e8377460cb21bb016acd86e6c, user.id=1cddedc3c34c45088c1f470d3dad009a, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:13.394736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:13.396180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c690e7-049b-4866-93ee-d6ad83648b82 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:13.410696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 168/334] 10.222.0.88 () {56 vars in 1308 bytes} [Mon Aug 29 23:09:13 2022] GET /identity/v3/role_assignments?user.id=1cddedc3c34c45088c1f470d3dad009a&scope.system=all&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:14.789720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398a9b8-f8d3-4521-a87f-c9359c35eab1 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:14.790229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398a9b8-f8d3-4521-a87f-c9359c35eab1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:14.790314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398a9b8-f8d3-4521-a87f-c9359c35eab1 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:14.792148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 167/335] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:09:14.798080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7c00-0288-4b44-b2a2-141f0563b0f4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:14.798512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7c00-0288-4b44-b2a2-141f0563b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:14.798712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7c00-0288-4b44-b2a2-141f0563b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:14.826134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0a6e7c00-0288-4b44-b2a2-141f0563b0f4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:14.827387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0a6e7c00-0288-4b44-b2a2-141f0563b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:14.846458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:14.910806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 169/336] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:15.326240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398a9b8-f8d3-4521-a87f-c9359c35eab1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:15.361884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5e3d-672f-4f8d-9247-67d28d9c203a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:15.362199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5e3d-672f-4f8d-9247-67d28d9c203a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:15.362447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e5e3d-672f-4f8d-9247-67d28d9c203a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:15.364066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 170/337] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:15.369015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee05b2-1698-4305-94db-fce2f942366a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:15.369337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee05b2-1698-4305-94db-fce2f942366a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:15.369617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee05b2-1698-4305-94db-fce2f942366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:15.396896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:15.400730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-edee05b2-1698-4305-94db-fce2f942366a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:15.402160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-edee05b2-1698-4305-94db-fce2f942366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:15.482949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 171/338] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:15.484242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba764d-37d6-4249-a744-e14f788f60af None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:15.484531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba764d-37d6-4249-a744-e14f788f60af None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:15.484809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba764d-37d6-4249-a744-e14f788f60af None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:15.486197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 172/339] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:15.489479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398a9b8-f8d3-4521-a87f-c9359c35eab1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:15.491502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:15.491790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:15.492062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:15.510908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:15.512105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:15.565862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:15.566892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:15.567396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:15.567899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:15.595163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:15.600947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:15.601988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:15.602784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:15.604094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 173/340] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:15.605924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 168/341] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:15.611253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:15.638395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:15.747738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308772d-6f45-45df-a91c-38b61ec48c7a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:15.796263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:15.796891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:15.797199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:15.797478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:15.798152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:15.798664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:15.799839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8258a60-5c1e-49fb-982d-db2c9cf2d480 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:15.813182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 174/342] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:15.818871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:15.972564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beccaa-0bdc-4077-9f39-1d78ec3c3547 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:15.991348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.011314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.011929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.012205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.012475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.048494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d9849-6aee-46a8-9bf2-83b9801fa790 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.048822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d9849-6aee-46a8-9bf2-83b9801fa790 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.049056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d9849-6aee-46a8-9bf2-83b9801fa790 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.051015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 175/343] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:16.057656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.058106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.058384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.087176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:16.089319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:16.106213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:16.107531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:16.192076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 176/344] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 23:09:16.192945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.193388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 169/345] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:16.194284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.209215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.219074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.304188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155074d-8fd9-4c63-aa6f-3e9265f540f7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.344564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.345238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.345525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.345794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.358613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:16.363665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:16.364564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:16.365394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 170/346] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:16.366054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.385863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c66c-479c-4ed9-8512-7362bfe159da None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.435370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.436177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.436459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.437062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.458807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:16.470216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:16.471158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:16.471961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:16.473340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 177/347] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:16.473924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.474039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.530954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899b30-2706-4cd1-bafe-d16e86c506c4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.586260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.606786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.607377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.607659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.607934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.610345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:16.611814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:16.613572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 171/348] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:16.614422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.631925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092b168-de60-45cb-8cb8-eb804e976b32 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.673262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.674141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.674622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.675147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.676005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:16.676452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:16.678153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:16.688334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 178/349] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:16.689479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.748524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12b531-7cc0-48be-a6ea-6e559ff98745 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.784342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.785248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.785784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.786193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.787038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:16.787525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:16.789066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:16.798156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 172/350] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:16.799228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.807777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552f4d0-7bc0-4f61-bb1c-a7cf5781f60c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.810190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.836843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:16.846437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.847238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.847354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.847689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.855036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:16.856547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:16.858271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 179/351] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:16.859057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.913537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11572929-3445-4499-b643-c37081ebbf32 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:16.954113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:16.955157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:16.955631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:16.956097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] PATH_INFO: `/v3/users/aff2faa7f2d14472bb70ce05d3940394` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:16.957590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] RBAC: Authorizing `identity:get_user(user_id=aff2faa7f2d14472bb70ce05d3940394)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:16.959110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:16.961159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 173/352] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/users/aff2faa7f2d14472bb70ce05d3940394 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:16.961960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:16.973026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48693e-2728-43d6-b4e1-73e58911e415 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.017263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.018005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.018351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.018695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.030495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:17.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:17.039239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 180/353] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:17.040410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:17.049388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.083448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786ae1e-6dd2-48eb-8fb2-2a844a18683b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.111516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.127777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.127777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.127777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.127777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.176188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934213ae-0d0b-45b0-914f-a7bdbed312eb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.212707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:17.213856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:17.217598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.219106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.220712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.220712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.221051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=a6d401ac09b64a7a84d25278403a2720) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:17.225182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:17.225182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93398edd-170e-48d0-8e1a-684d0f621c94 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:17.231583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 181/354] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:17 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:17.232824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de869-4c14-4d6a-ac31-4c1118e17e60 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.233126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de869-4c14-4d6a-ac31-4c1118e17e60 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.233428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de869-4c14-4d6a-ac31-4c1118e17e60 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.234793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 182/355] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:17.235343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de869-4c14-4d6a-ac31-4c1118e17e60 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:17.328931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.365099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 174/356] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:17.366510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:17.390096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de869-4c14-4d6a-ac31-4c1118e17e60 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.413405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.444439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.445245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.445529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.445860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.446535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] RBAC: Adding query filter params (role.id=316f0e38f78f4eb09fca1ae4e603f5ab, user.id=aff2faa7f2d14472bb70ce05d3940394, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:17.446849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:17.449617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a198d-66c0-4273-a29c-1a55b355f92a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:17.463817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 183/357] 10.222.0.88 () {56 vars in 1308 bytes} [Mon Aug 29 23:09:17 2022] GET /identity/v3/role_assignments?user.id=aff2faa7f2d14472bb70ce05d3940394&scope.system=all&role.id=316f0e38f78f4eb09fca1ae4e603f5ab => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:17.464884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.465305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.465584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.497161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:17.498408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:17.550502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1d3b6-ae5e-444b-9bde-a127de328b72 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.609695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.610332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.610616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.610889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.611577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:17.611881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:17.613336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0c07d-37cf-492d-a1d0-db21e7d304bb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:17.615861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 184/358] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:17.617144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:17.624386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 175/359] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:17.625820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af19c7-661a-4049-84c3-225afff89515 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.626001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af19c7-661a-4049-84c3-225afff89515 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.626600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af19c7-661a-4049-84c3-225afff89515 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.627746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 176/360] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:17.632566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af19c7-661a-4049-84c3-225afff89515 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:17.683727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.756544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d79340-faff-4aca-a0ab-024387ff001a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.759273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.782919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af19c7-661a-4049-84c3-225afff89515 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:17.811040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ee19-9983-4eb1-8be0-84be0e18288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.812970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ee19-9983-4eb1-8be0-84be0e18288f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.813654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ee19-9983-4eb1-8be0-84be0e18288f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.814287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ee19-9983-4eb1-8be0-84be0e18288f None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.815955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ee19-9983-4eb1-8be0-84be0e18288f None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:17.818388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ee19-9983-4eb1-8be0-84be0e18288f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:17.821463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 185/361] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:17 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:17.823124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.823674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.824467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.835048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:17.835951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:17.836423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:17.837230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:17.855361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:17.856666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:17.928015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:17.930035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:17.969529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:17.974170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 186/362] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:17.975205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.075258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 177/363] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:18.076108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.112796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730d822-6471-4450-9de1-2f14d7af73fc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.114572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.160669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.161924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.162522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.162811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.163990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.165555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.167965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 187/364] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:17 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:18.168877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.215526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c174d-d040-4eff-8cc5-d74a2bd55ac6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.254314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.255020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.255295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.255561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.258389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.268275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:18.274997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:18.276741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 178/365] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:18.277978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.287306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61820516-b21b-4ded-8e75-a0f8f4c8bff0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.331887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.332528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.332802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.333071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.335413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.336900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.340501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 188/366] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:18.341387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.389910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.407965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626bf4-f9a1-4bad-8755-77ef5eb37ce4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.458033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.458033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.458295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.458365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.459452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=a6d401ac09b64a7a84d25278403a2720) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:18.459452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.460888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.468054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 179/367] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:18.468883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.482835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957dfd6-7fd6-4006-9ba1-0458a62dd36b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.537073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.538145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.538432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.538702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.540100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:18.540415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.543629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.549867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.560928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 189/368] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:18.562134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.612641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7f5da-7cea-47bf-a24e-58e00f712ba5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.668112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.668945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.669377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.669754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.685974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:18.692270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:18.693189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:18.693982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 180/369] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:18.694680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.718414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.722644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a87b6e-8e22-498b-8a0f-360b74127022 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.763190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.764317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.764809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.765305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.766633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.768516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.770873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 190/370] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:18.771878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.816785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8fb9-a031-454b-bdf7-f45e6fdc38a2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.842099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:18.857143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.857779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.858499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.858499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.897070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edfa38-e92d-4134-bf52-af2f385ece83 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:18.933266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.935001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.937917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:18.938928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:18.939426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:18.939902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:18.940787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:18.941319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:18.943018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:18.953635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 191/371] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:18.954913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:18.990058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.046018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 181/372] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:19.046655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.071486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825dac3-b5d8-4b8e-922f-d6613f992710 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.075656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.112150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.113231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.113814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.114352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.115280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=d5ee96b1a5b843d9be5325d726a95585) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:19.115807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.117744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.129616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 192/373] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:18 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:19.130869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.168524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c65a-6687-400f-99d8-d067f0b8c5f7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.217610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb5614-b2f3-49f1-b327-03374f3d17bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.218237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5614-b2f3-49f1-b327-03374f3d17bf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.218520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5614-b2f3-49f1-b327-03374f3d17bf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.218798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5614-b2f3-49f1-b327-03374f3d17bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.329473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.342760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d23dc-b91c-46eb-8d39-5e002adc8099 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.368596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb5614-b2f3-49f1-b327-03374f3d17bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.370523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb5614-b2f3-49f1-b327-03374f3d17bf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.403313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.412785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.413515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.413792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.414062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.415300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.417372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.419140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 193/374] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:19.424591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.512838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 182/375] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:19.514201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc8ce-adfe-4939-83d4-a89e647e92ca None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.514486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc8ce-adfe-4939-83d4-a89e647e92ca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.514759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cc8ce-adfe-4939-83d4-a89e647e92ca None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.516184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 183/376] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:19.519597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc8ce-adfe-4939-83d4-a89e647e92ca None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.562061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61eaab-362c-4a50-ae04-2e78ff355109 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.603923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38c0e5-d966-4804-878c-b55e4cb46c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.604896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38c0e5-d966-4804-878c-b55e4cb46c45 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.605416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38c0e5-d966-4804-878c-b55e4cb46c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.605915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38c0e5-d966-4804-878c-b55e4cb46c45 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.607716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38c0e5-d966-4804-878c-b55e4cb46c45 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.609402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38c0e5-d966-4804-878c-b55e4cb46c45 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.611561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 194/377] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:19.613014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.613531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.614001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.639359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:19.640875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:19.646329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cc8ce-adfe-4939-83d4-a89e647e92ca None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.673509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.674038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.699266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.700199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.700599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.700971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] PATH_INFO: `/v3/projects/d0262c974ef34627ad89ce1c8f11f804` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.702283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] RBAC: Authorizing `identity:get_project(project_id=d0262c974ef34627ad89ce1c8f11f804)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.703944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.706132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 184/378] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/projects/d0262c974ef34627ad89ce1c8f11f804 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:19.707050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.729971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 195/379] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:19.730861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.852918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365ca1b-b26d-4e6a-93bb-f770c27ffd6b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.893844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.894409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.894694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.894968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] PATH_INFO: `/v3/groups/2deb755ba2744cd79f2f6e0715f01c13` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.901565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] RBAC: Authorizing `identity:get_group(group_id=2deb755ba2744cd79f2f6e0715f01c13)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.903030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.905102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 196/380] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/groups/2deb755ba2744cd79f2f6e0715f01c13 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:19.910584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:19.927851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667689b-b078-4496-b958-eb53210fee83 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:19.967654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:19.971244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:19.971969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:19.972205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:19.972480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:19.973233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=d5ee96b1a5b843d9be5325d726a95585) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:19.977137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:19.977137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:19.984644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 185/381] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:20.110827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c566c4a-90b8-47ef-a533-f94eec2eb48a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:20.151590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:20.157974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:20.158586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.158866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.159134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.159853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] RBAC: Adding query filter params (group.id=2deb755ba2744cd79f2f6e0715f01c13, role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=d0262c974ef34627ad89ce1c8f11f804) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:20.160155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:20.161661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:20.171217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 197/382] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:19 2022] GET /identity/v3/role_assignments?group.id=2deb755ba2744cd79f2f6e0715f01c13&scope.project.id=d0262c974ef34627ad89ce1c8f11f804&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:20.228033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:20.290895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9f7f0-a6e5-44bb-9a09-a8d66884f984 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:20.329833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:20.330487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.330765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.331038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.343303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:20.348987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:20.349988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:20.350807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:20.353053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 186/383] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:20.356689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:20.474711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:20.488654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095f4d-12eb-481e-bdde-76f3cc6dc126 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:20.535059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:20.535723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.536007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.536282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.536956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:20.537296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:20.538689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:20.553045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 198/384] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:20.558808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:20.670160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3578b-d025-4a4a-8624-ea9a9f790104 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:20.693711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:20.706189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb179905-2280-4280-a04b-75619abdec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:20.707176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb179905-2280-4280-a04b-75619abdec7c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.707462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb179905-2280-4280-a04b-75619abdec7c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.707742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb179905-2280-4280-a04b-75619abdec7c None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.708964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb179905-2280-4280-a04b-75619abdec7c None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:20.710584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb179905-2280-4280-a04b-75619abdec7c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:20.716725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 187/385] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:20 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:20.719050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:20.846544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255264e-c0ae-422a-b9c5-b2c9ff01b4ff None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:20.867150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4ede0-47f1-451b-9673-c28acf4019d6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.867462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4ede0-47f1-451b-9673-c28acf4019d6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.867694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4ede0-47f1-451b-9673-c28acf4019d6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.869970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 188/386] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:09:20.877465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.877799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.878097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.903600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:20.904800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:20.921892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:20.922903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:20.923383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:20.923864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:20.930287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:20.933443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:20.937094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 199/387] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:20 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:20.948128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:20.987578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:20.999213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 189/388] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:21.123245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127dba4-8584-4c7b-909f-ccaca9f850cf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:21.179463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:21.180542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:21.181095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:21.182222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720/groups/1ba16817534949b9a82fbd67162fc54b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:21.186898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6d401ac09b64a7a84d25278403a2720, group_id=1ba16817534949b9a82fbd67162fc54b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:21.189537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:21.215557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 200/389] 10.222.0.88 () {58 vars in 1442 bytes} [Mon Aug 29 23:09:20 2022] PUT /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720/groups/1ba16817534949b9a82fbd67162fc54b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:09:21.475326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:21.595149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16987d2-7ed0-40d2-a5fb-3f32aaf4226b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:21.606920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:21.636524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:21.637556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:21.638070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:21.638553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:21.649572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:21.656057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:21.656951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:21.657773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:21.660362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 190/390] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:21.666482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:21.810454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:21.819074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d6c74-ffe8-4ca7-a16d-e93e065f8bb9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:21.857742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:21.858370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:21.858649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:21.858921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:21.859605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:21.859908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:21.861317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:21.870581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 201/391] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:21.876190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:22.002217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2974-94aa-42b9-b689-510254111992 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:22.049918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f390c1-d022-4136-9d7a-85d8d58b341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:22.050934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f390c1-d022-4136-9d7a-85d8d58b341c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.051466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f390c1-d022-4136-9d7a-85d8d58b341c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.051949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f390c1-d022-4136-9d7a-85d8d58b341c None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.057867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f390c1-d022-4136-9d7a-85d8d58b341c None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:22.059564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f390c1-d022-4136-9d7a-85d8d58b341c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:22.061752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 191/392] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:21 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:22.067057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:22.155676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad96892-847e-4ada-a73c-a2506873784b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.156297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad96892-847e-4ada-a73c-a2506873784b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.156791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad96892-847e-4ada-a73c-a2506873784b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.158732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 192/393] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:09:22.164766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.165435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.166501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.198811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb27065-ac4e-4c2a-9ebe-c50db86a19a0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:22.200234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:22.201679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:22.233406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:22.234043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.234318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.234585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.235883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:22.237399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:22.239052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 202/394] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:22 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:22.245510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:22.257317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:22.260839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:22.355233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf589ecb-9939-4d72-9917-dcf9295d6096 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:22.362582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 193/395] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:22.391514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a07cc-a483-4b1d-9c71-191501906d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:22.392575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a07cc-a483-4b1d-9c71-191501906d45 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.392991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a07cc-a483-4b1d-9c71-191501906d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.393441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a07cc-a483-4b1d-9c71-191501906d45 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720/groups/1ba16817534949b9a82fbd67162fc54b/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.395781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a07cc-a483-4b1d-9c71-191501906d45 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6d401ac09b64a7a84d25278403a2720, group_id=1ba16817534949b9a82fbd67162fc54b, role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:22.397470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a07cc-a483-4b1d-9c71-191501906d45 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:22.419245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 203/396] 10.222.0.88 () {58 vars in 1442 bytes} [Mon Aug 29 23:09:22 2022] PUT /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720/groups/1ba16817534949b9a82fbd67162fc54b/roles/735d69de30e14d03a5a17f594ad42f5a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:22.771042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:22.819123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010223-b322-4106-98de-cbf7f7fd17fc None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.819766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010223-b322-4106-98de-cbf7f7fd17fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.820265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010223-b322-4106-98de-cbf7f7fd17fc None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.822688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 204/397] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:22.828281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2fbd-14b7-48c0-876f-ceaaa7490aee None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.828804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2fbd-14b7-48c0-876f-ceaaa7490aee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.829321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee2fbd-14b7-48c0-876f-ceaaa7490aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.860071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e5ee2fbd-14b7-48c0-876f-ceaaa7490aee None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:22.861295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e5ee2fbd-14b7-48c0-876f-ceaaa7490aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:22.922836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4986-d7ab-4c89-8f8b-84b2dbd4397d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:22.958891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:22.961388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:22.962234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.963160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.963530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.968630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 205/398] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:22.970931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ef129-b808-451d-a589-a9716aba5e72 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.971524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ef129-b808-451d-a589-a9716aba5e72 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.972109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ef129-b808-451d-a589-a9716aba5e72 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.973663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 206/399] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:22.975488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:22.979339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:22.979870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:22.980357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:22.981835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:22.982735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:22.983539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:22.987917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 194/400] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:22.989282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.018262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:23.019003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.021098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:23.093223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae281cf-6785-4365-915b-a159ad1b7395 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.130068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:23.130681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:23.130961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:23.131234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:23.131905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:23.132205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:23.133614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:23.147948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 195/401] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:23.149212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.196607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 207/402] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:23.269465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.279118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec4f8-17d6-4d72-8f4b-40821da373e0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.314741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:23.315377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:23.315657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:23.315933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:23.317045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:23.318518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:23.325421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 196/403] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:23 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:23.326830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.373994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.465452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90db1-e0d8-43ec-963e-46046285dccf None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.523337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.531759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131de6c1-8e74-4928-8b82-0e57c5be6921 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.547976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:23.548627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:23.548906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:23.549198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:23.553773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:23.555224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:23.558010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 208/404] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:23 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:23.565936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.583348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:23.584339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:23.584803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:23.585282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:23.608964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:23.614421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:23.615347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:23.616128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 197/405] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:23.621695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.642969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.702954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb96f3e-29d8-494a-b2b3-c248ce70e453 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.732887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d835e0-1b59-4c70-b384-a976e3d4b2a4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.738961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:23.739638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:23.739969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:23.740246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585/groups/1ba16817534949b9a82fbd67162fc54b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:23.742386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ee96b1a5b843d9be5325d726a95585, group_id=1ba16817534949b9a82fbd67162fc54b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:23.744713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:23.765203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 209/406] 10.222.0.88 () {58 vars in 1442 bytes} [Mon Aug 29 23:09:23 2022] PUT /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585/groups/1ba16817534949b9a82fbd67162fc54b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:23.766502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.789677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:23.790944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:23.791613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:23.793086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:23.819149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:23.827247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:23.828235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:23.829071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:23.835393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 198/407] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:23.840767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:23.897482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.952086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcd285-c8d3-458a-99c5-667e6e4a56fb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:23.963852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:23.988483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aa666-8b16-4802-826b-8682635624b5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.002820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.004234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.004974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.005477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.006624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:24.007573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.009212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8c982-d634-4618-84ad-b782f6bbba36 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.022050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 210/408] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:24.028674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e0cb1-9d8c-4a59-a57d-58b5035c96e1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.028825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.028825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.028825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.028825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.029552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:24.029552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.029552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c04c-9d0b-42ba-8b1f-ee74d4852c7b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.030328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e0cb1-9d8c-4a59-a57d-58b5035c96e1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.030853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e0cb1-9d8c-4a59-a57d-58b5035c96e1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.033226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 211/409] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:24.034170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e0cb1-9d8c-4a59-a57d-58b5035c96e1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.039920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 199/410] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:24.041225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.041626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.041986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.061705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:24.063018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:24.139134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 200/411] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:24.140156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.180422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e0cb1-9d8c-4a59-a57d-58b5035c96e1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.208625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:24.221808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:24.233400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.235080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.235567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.236043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.237729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.240213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.243098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 212/412] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:24 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:24.249126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.258705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6aa8-81eb-4e44-9c2f-44326af40856 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.300003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.300638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.300918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.301238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] PATH_INFO: `/v3/groups/2deb755ba2744cd79f2f6e0715f01c13` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.302472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] RBAC: Authorizing `identity:get_group(group_id=2deb755ba2744cd79f2f6e0715f01c13)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.304354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.306097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 201/413] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:24 2022] GET /identity/v3/groups/2deb755ba2744cd79f2f6e0715f01c13 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:24.315510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.374786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd44030-8480-4fed-94d3-bf6da2bb7227 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.416712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.418281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.418985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.419494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.421461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.423099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.425209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 213/414] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:24 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:24.432467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.505873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:24.530973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151586bc-f91c-4eec-935d-6b98a160d245 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.554782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468bde3-5ad0-4a6e-8552-09e159b70de2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.598364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.599376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.600404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.600901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585/groups/1ba16817534949b9a82fbd67162fc54b/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.603931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5ee96b1a5b843d9be5325d726a95585, group_id=1ba16817534949b9a82fbd67162fc54b, role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.605972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.626188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.626953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.627341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.627729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] PATH_INFO: `/v3/projects/d0262c974ef34627ad89ce1c8f11f804` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.628089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 214/415] 10.222.0.88 () {58 vars in 1442 bytes} [Mon Aug 29 23:09:24 2022] PUT /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585/groups/1ba16817534949b9a82fbd67162fc54b/roles/735d69de30e14d03a5a17f594ad42f5a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:24.629151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.635645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] RBAC: Authorizing `identity:get_project(project_id=d0262c974ef34627ad89ce1c8f11f804)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.641421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.647493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 202/416] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:24 2022] GET /identity/v3/projects/d0262c974ef34627ad89ce1c8f11f804 => generated 344 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:24.652480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.675380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:24.833781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d5fa6-af1f-448d-9683-566c44a61fd4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.848663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1c418-0880-4d86-987a-79e946b2de6c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:24.849353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:24.870380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e257fa8-57f4-45c1-a24d-8e586df42978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.871158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e257fa8-57f4-45c1-a24d-8e586df42978 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.871516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e257fa8-57f4-45c1-a24d-8e586df42978 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.871873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e257fa8-57f4-45c1-a24d-8e586df42978 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.885080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e257fa8-57f4-45c1-a24d-8e586df42978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9e257fa8-57f4-45c1-a24d-8e586df42978 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:24.891139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:24.892010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:24.892840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:24.893465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beee7d-cf55-4bac-9198-1caba5f1c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:24.893465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beee7d-cf55-4bac-9198-1caba5f1c911 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.893465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beee7d-cf55-4bac-9198-1caba5f1c911 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.893465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beee7d-cf55-4bac-9198-1caba5f1c911 None admin] PATH_INFO: `/v3/projects/d0262c974ef34627ad89ce1c8f11f804/groups/2deb755ba2744cd79f2f6e0715f01c13/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.893725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 215/417] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:24.894410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065584dc-1b9a-4a38-829f-d1c4b18e4d59 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.894926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065584dc-1b9a-4a38-829f-d1c4b18e4d59 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.895353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065584dc-1b9a-4a38-829f-d1c4b18e4d59 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.901387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 216/418] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:24.902360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065584dc-1b9a-4a38-829f-d1c4b18e4d59 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:24.902467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beee7d-cf55-4bac-9198-1caba5f1c911 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0262c974ef34627ad89ce1c8f11f804, group_id=2deb755ba2744cd79f2f6e0715f01c13, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:24.904242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beee7d-cf55-4bac-9198-1caba5f1c911 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:24.923830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 203/419] 10.222.0.88 () {58 vars in 1442 bytes} [Mon Aug 29 23:09:24 2022] PUT /identity/v3/projects/d0262c974ef34627ad89ce1c8f11f804/groups/2deb755ba2744cd79f2f6e0715f01c13/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:24.925655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:24.925945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:24.926223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:24.952863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:24.954786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:25.081630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065584dc-1b9a-4a38-829f-d1c4b18e4d59 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:25.088809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:25.098114 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 204/420] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:25.122783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:25.123396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:25.123675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:25.123945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:25.124602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:25.124900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:25.126316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:25.134990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 217/421] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:25.140480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:25.248480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453363cc-ca7d-423e-aa16-60c2c844b702 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:25.288181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:25.288793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:25.289068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:25.289364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:25.360280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:25.372752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:25.374364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:25.513357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 205/422] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:25.518784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:25.572638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:25.588561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:25.691885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3115fa-db77-40e8-8b4c-c1eac590f8b9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:25.727987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:25.729457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:25.729734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:25.730004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:25.733135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:25.733135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:25.734641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 218/423] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:25 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:25.742073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:25.769101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:25.780106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27208e54-947b-4cdd-9280-5b9ff8bedfe9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:25.846030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:25.846677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:25.846955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:25.847229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:25.870321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:25.875261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:25.876137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:25.876937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:25.880936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 206/424] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:25.886159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:25.923159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76ae45-74a7-4c6f-bce3-197607efdfb1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:25.926330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:25.987751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff739bbe-7919-4338-a5be-4b9bc54891e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:25.988397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739bbe-7919-4338-a5be-4b9bc54891e9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:25.988676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739bbe-7919-4338-a5be-4b9bc54891e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:25.988946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff739bbe-7919-4338-a5be-4b9bc54891e9 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:25.992482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff739bbe-7919-4338-a5be-4b9bc54891e9 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:25.996343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff739bbe-7919-4338-a5be-4b9bc54891e9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:26.000516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 219/425] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:25 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:26.002372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf35ea2-673f-4046-aed0-5c21ab35536a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.002657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf35ea2-673f-4046-aed0-5c21ab35536a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.002937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf35ea2-673f-4046-aed0-5c21ab35536a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.004987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 220/426] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:26.010615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf35ea2-673f-4046-aed0-5c21ab35536a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:26.068079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50cbe-4fb5-4a05-8be9-289ac182941f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:26.115525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:26.116645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.116933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.117671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.118631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:26.118990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:26.120782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d43b6-2770-47b0-98b8-d7d287746f0c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:26.132055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 207/427] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:26.133234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.133521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.133798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.152816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf35ea2-673f-4046-aed0-5c21ab35536a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:26.159261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:26.160461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:26.175914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:26.189822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:26.190437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.190716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.190993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.191723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=a6d401ac09b64a7a84d25278403a2720) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:26.192031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:26.193518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:26.200330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 221/428] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:26 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:26.201395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:26.244199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:26.256216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 208/429] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:26.370522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a594d9-7d22-439d-8309-57c5f415f12a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:26.415255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:26.415821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.416107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.416468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.490350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:26.491886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:26.532662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:26.597799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:26.649737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 222/430] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:26.656438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:26.760085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8bb2-2bb1-4c9f-bb57-7787105ae654 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:26.788134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb2a2-ebef-49eb-8d38-98189324b180 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:26.808716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:26.809640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.810063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.810479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.826049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:26.827070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52afce-bf59-4d97-8ddd-9adef5d824d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:26.827711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52afce-bf59-4d97-8ddd-9adef5d824d9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.827993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52afce-bf59-4d97-8ddd-9adef5d824d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.828322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52afce-bf59-4d97-8ddd-9adef5d824d9 None admin] PATH_INFO: `/v3/projects/a6d401ac09b64a7a84d25278403a2720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.829482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52afce-bf59-4d97-8ddd-9adef5d824d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a6d401ac09b64a7a84d25278403a2720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:26.830944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52afce-bf59-4d97-8ddd-9adef5d824d9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:26.831791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:26.832680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:09:26.833528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:26.834137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 223/431] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:26 2022] GET /identity/v3/projects/a6d401ac09b64a7a84d25278403a2720 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:26.834212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 209/432] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:26.839044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302eb0d-94d9-4bcf-b2e2-78d08577636d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.839334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302eb0d-94d9-4bcf-b2e2-78d08577636d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.839611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302eb0d-94d9-4bcf-b2e2-78d08577636d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.839864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:26.842367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 224/433] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:26.846623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:26.846911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:26.847194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:26.855231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:26.857224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:26.872112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:26.874125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:26.964517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421d6b-6430-4d24-a939-3e4460a7e390 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:26.966896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 225/434] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:26.968037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.028833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.029741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.030168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.031136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.031971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:27.032441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.034952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.048262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 210/435] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:27.054054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.098351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408d51e-5266-4f11-8fe5-b5f49c4ba649 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.137264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.137915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.138178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.138448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.139567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.141009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.147095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 226/436] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:26 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:27.148365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.149150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.156060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.184815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e53a7-a258-423d-baca-7cb620587096 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.220735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204c71-98d8-46ee-a292-50b630aba8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.221364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204c71-98d8-46ee-a292-50b630aba8da None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.221642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204c71-98d8-46ee-a292-50b630aba8da None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.221910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204c71-98d8-46ee-a292-50b630aba8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.266419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2cd6-1c0a-4726-944b-2f06b10a2d89 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.291405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204c71-98d8-46ee-a292-50b630aba8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.292854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204c71-98d8-46ee-a292-50b630aba8da None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.301273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.301877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.302160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.302432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.303153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=a6d401ac09b64a7a84d25278403a2720) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:27.303458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.304869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6e2af-1af8-4452-906a-06b489d05f98 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.310502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 227/437] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=a6d401ac09b64a7a84d25278403a2720&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:27.311842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d742f5-a5b6-4edb-b88e-da9abd34bce2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.312133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d742f5-a5b6-4edb-b88e-da9abd34bce2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.312415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d742f5-a5b6-4edb-b88e-da9abd34bce2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.313830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 228/438] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:27.318816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d742f5-a5b6-4edb-b88e-da9abd34bce2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.369252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.397051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.409443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 211/439] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:27.411447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.411734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.412010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.432065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:27.433309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:27.440201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d742f5-a5b6-4edb-b88e-da9abd34bce2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.484662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.485324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.485600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.485873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.500816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:27.505879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:27.506833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:27.507755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 229/440] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:27.508590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.516333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 212/441] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:27.516333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.640280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c7696-f39b-4722-a0d4-da28e24bd2d8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.653090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.660203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ecc49-4d27-4077-9c1d-c7b558590bad None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.673549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.692554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.693239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.693521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.693791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.695293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.697903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.699760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 230/442] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:27.705531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.707897 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.708504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.708782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.709056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.709761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:27.710062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.711444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.720845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 213/443] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:27.726644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.830186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd7ba-e999-4203-93a1-8f25dc49cede None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.842142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f25e34-0685-4264-9e42-b678c141e1b9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:27.863104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.863757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.864041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.864314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.865451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.866897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.868435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 231/444] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:27.873423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:27.880052 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:27.880647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:27.880932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:27.881227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:27.911113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.930581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:27.953007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:27.954514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:27.968928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd6db7-b9ea-434e-9c3d-997303a17c00 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.002511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.003137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.003416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.003679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.014349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:28.019584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:28.020557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:28.021389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 232/445] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:28.022059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.057987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 214/446] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:28.059281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.120346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4cc3-547c-4e2c-84ba-f8ef4b598ca6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.120573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:28.143061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:28.155941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.156552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.156828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.157099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.157878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=d3a9964e8377460cb21bb016acd86e6c, scope.project.id=d5ee96b1a5b843d9be5325d726a95585) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:28.158186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.159652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.161448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb239277-86b7-4217-99f3-c353b478a9e9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.165224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 233/447] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=d3a9964e8377460cb21bb016acd86e6c => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:28.166555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.199479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.200110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.200387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.200661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.201373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:28.201678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.203085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.212051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 215/448] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:28.218502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.283738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93593ab-f38d-46d8-a3fd-260b82a7bc72 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.322693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.323432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.323705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.323973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] PATH_INFO: `/v3/projects/d5ee96b1a5b843d9be5325d726a95585` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.325707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] RBAC: Authorizing `identity:get_project(project_id=d5ee96b1a5b843d9be5325d726a95585)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.327164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.328981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 234/449] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/projects/d5ee96b1a5b843d9be5325d726a95585 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:28.334199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.340235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd5c7-14c6-4c01-8d0c-60ef9f04ffcb None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.370496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:28.385729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.386349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.387614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.387614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.399060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:28.460726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85443a73-ce74-4cc2-bf03-1a45bba11ccf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.475893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.477381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.501504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.502148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.502421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.502693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] PATH_INFO: `/v3/groups/1ba16817534949b9a82fbd67162fc54b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.503820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] RBAC: Authorizing `identity:get_group(group_id=1ba16817534949b9a82fbd67162fc54b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.505306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.507033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 235/450] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/groups/1ba16817534949b9a82fbd67162fc54b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:28.513078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.583622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 216/451] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:28.591004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.615866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:28.620855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae642da-1be0-4906-9cdf-692c4b17a21c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.644085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:28.656442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.656989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.657369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.657645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.658355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] RBAC: Adding query filter params (group.id=1ba16817534949b9a82fbd67162fc54b, role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=d5ee96b1a5b843d9be5325d726a95585) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:28.658660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.660077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.665631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 236/452] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/role_assignments?group.id=1ba16817534949b9a82fbd67162fc54b&scope.project.id=d5ee96b1a5b843d9be5325d726a95585&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:28.696169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32004b-fe34-4413-a669-afab755fc3f6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.734303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.734952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.735233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.735509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] PATH_INFO: `/v3/projects/d0262c974ef34627ad89ce1c8f11f804` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.736701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] RBAC: Authorizing `identity:get_project(project_id=d0262c974ef34627ad89ce1c8f11f804)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.738196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.739907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 217/453] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/projects/d0262c974ef34627ad89ce1c8f11f804 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:28.746145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:28.859251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480a960-df70-4ffa-b9f9-53776538ac70 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:28.895055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf942-c643-481a-96f7-efca75b25c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:28.895692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf942-c643-481a-96f7-efca75b25c6e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:28.895971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf942-c643-481a-96f7-efca75b25c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:28.896242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf942-c643-481a-96f7-efca75b25c6e None admin] PATH_INFO: `/v3/groups/2deb755ba2744cd79f2f6e0715f01c13` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:28.897366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf942-c643-481a-96f7-efca75b25c6e None admin] RBAC: Authorizing `identity:get_group(group_id=2deb755ba2744cd79f2f6e0715f01c13)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:28.898800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf942-c643-481a-96f7-efca75b25c6e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:28.901352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 237/454] 10.222.0.88 () {56 vars in 1180 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/groups/2deb755ba2744cd79f2f6e0715f01c13 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:28.907233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:29.004703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:29.014333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04704125-b634-4eb7-8931-cd01578b6f64 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:29.047105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:29.047700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:29.047980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:29.048257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:29.048980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] RBAC: Adding query filter params (group.id=2deb755ba2744cd79f2f6e0715f01c13, role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=d0262c974ef34627ad89ce1c8f11f804) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:29.049321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:29.050747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383c6b-9305-475d-b48a-adc13a7cd746 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:29.056861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 218/455] 10.222.0.88 () {56 vars in 1376 bytes} [Mon Aug 29 23:09:28 2022] GET /identity/v3/role_assignments?group.id=2deb755ba2744cd79f2f6e0715f01c13&scope.project.id=d0262c974ef34627ad89ce1c8f11f804&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:31.419845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464a89-e689-4a0e-83f9-78f479d54ea7 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:31.420368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464a89-e689-4a0e-83f9-78f479d54ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:31.420368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464a89-e689-4a0e-83f9-78f479d54ea7 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:31.422170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 238/456] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:31.427662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a57df8-b5c2-40a0-9196-4a560a5831d1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:31.428073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a57df8-b5c2-40a0-9196-4a560a5831d1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:31.428230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a57df8-b5c2-40a0-9196-4a560a5831d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:31.446714 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a7a57df8-b5c2-40a0-9196-4a560a5831d1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:31.448060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a7a57df8-b5c2-40a0-9196-4a560a5831d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:31.535693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 219/457] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:31.646339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f2244-9dfc-47db-ab38-085f60eeecd1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:31.646613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f2244-9dfc-47db-ab38-085f60eeecd1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:31.647127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f2244-9dfc-47db-ab38-085f60eeecd1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:31.648662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 239/458] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:31.654841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eef23-a68d-4e04-87b3-063fe586a131 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:31.655377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eef23-a68d-4e04-87b3-063fe586a131 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:31.655847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eef23-a68d-4e04-87b3-063fe586a131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:31.682177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ba0eef23-a68d-4e04-87b3-063fe586a131 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:31.683819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ba0eef23-a68d-4e04-87b3-063fe586a131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:31.771186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 220/459] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:31.829518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1625-c4e3-4150-9893-8a03563b37c1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:31.830201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1625-c4e3-4150-9893-8a03563b37c1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:31.830675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1625-c4e3-4150-9893-8a03563b37c1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:31.832225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 240/460] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:31.838336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156e8f6-da29-4054-9fcc-4062398a00a2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:31.838634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156e8f6-da29-4054-9fcc-4062398a00a2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:31.838960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156e8f6-da29-4054-9fcc-4062398a00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:31.866086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e156e8f6-da29-4054-9fcc-4062398a00a2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:31.867314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e156e8f6-da29-4054-9fcc-4062398a00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:31.878824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:31.886692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1625-c4e3-4150-9893-8a03563b37c1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:31.942393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 221/461] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:31.977800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.027668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1625-c4e3-4150-9893-8a03563b37c1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.063221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.063960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.064239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.064513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.070023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16bcd-4816-41bc-b74d-de537742f7b5 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.070570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16bcd-4816-41bc-b74d-de537742f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.071035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16bcd-4816-41bc-b74d-de537742f7b5 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.073998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 222/462] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:09:32.079439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.079996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.080476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.080907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.081154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:32.096780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:32.097779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:32.098626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:32.098626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.098626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:32.098626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 241/463] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:32.103920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:32.105364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:32.109525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.220482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 223/464] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:32.221712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.246846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b67810-78fb-486f-b504-90e73e0cdba7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.254759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.284980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.285959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.286446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.286922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.287800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:32.288307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.289937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.304442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 242/465] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:32.311808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.314067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.340301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490c003-5a43-4605-8b30-29590acc6305 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.384515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.385541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.386005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.386457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.412723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.414332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:32.430622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:32.432948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:32.433838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:32.433838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.433838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:32.434661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 224/466] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:32.435198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.449960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afd668-2e78-48c1-882d-d5d87032c563 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.499904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.501165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.502016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.502714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.503557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.506135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.535506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 243/467] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:32 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:32.537201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.550915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940faa04-bbd3-464b-bd12-fe10266059e1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.576711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.583572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.600102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.601157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.601666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.601666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.616326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.620919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:32.639181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:32.640175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:32.641027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:32.641027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.641027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:32.645464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 225/468] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:32.646543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.699615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7d1e7-d21b-4a42-b964-f2d2e2e19d31 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.743070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.743793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.744077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.744348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.744993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:32.745343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.746715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.761361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 244/469] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:32.762134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.771544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1745-d49d-4e31-90d8-4eab5cc4d188 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.825546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.827080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.827543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.828241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.843360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.845827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.860104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:32.866229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:32.867107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:32.867960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:32.867960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:32.867960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:32.871176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 226/470] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:32.871792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.884593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef8e3a-feb8-4122-bb5c-9854f2d75942 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:32.906488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:32.921649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:32.922602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:32.923118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:32.923597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:32.924450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:32.924948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:32.926526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:32.939110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 245/471] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:32.940189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:32.984130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a88b5-5ab2-4dfb-9a36-1a1a58fbdd0b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:33.019870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:33.020398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.020773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.021053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.021854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:33.023178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:33.057139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 227/472] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:32 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:33.057139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:33.064003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d688b4-1e3d-420e-bff5-889db5caf610 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:33.131961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:33.133041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.133562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.134061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.134922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:33.135288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:33.136682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf43aeb-a49e-4a18-bbce-612238882a3b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:33.155806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 246/473] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:33.157145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a53ca-3591-413b-9b2b-538729b9f67f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.157441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a53ca-3591-413b-9b2b-538729b9f67f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.157717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a53ca-3591-413b-9b2b-538729b9f67f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.159440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 247/474] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:33.164362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a53ca-3591-413b-9b2b-538729b9f67f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:33.196950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:33.205406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:33.222993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330de4a-a503-4bc9-bf53-0c973d346c7f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:33.264975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e0d46-eab8-4f36-a97c-dbd68d0ddbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:33.265622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0d46-eab8-4f36-a97c-dbd68d0ddbb0 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.265907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0d46-eab8-4f36-a97c-dbd68d0ddbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.266184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0d46-eab8-4f36-a97c-dbd68d0ddbb0 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.266831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e0d46-eab8-4f36-a97c-dbd68d0ddbb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:33.268283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e0d46-eab8-4f36-a97c-dbd68d0ddbb0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:33.296329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 228/475] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:33 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:33.298375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.298664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.298943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.315429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a53ca-3591-413b-9b2b-538729b9f67f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:33.323810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:33.325033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:33.382722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:33.383380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.385471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.385471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.385948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:33.387469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:33.428205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 248/476] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:33 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:33.441274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 229/477] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:33.726209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:33.789671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:33.838995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0400bb6-77ac-43bf-bc76-9b4c65a6a3e1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:33.874663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:33.875197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:33.875486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:33.875763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:33.876434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:33.877855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:33.886226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.sql.core [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:09:33.886226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 23:09:33.886226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [parameters: {'id': '538076fac1654380b1207d24544fe31d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 23:09:33.886226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Aug 29 23:09:33.903954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:09:33.904883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application yield resource Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise self.value Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application session.commit() Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:09:33.905908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:09:33.906996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:09:33.907829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:09:33.908662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [parameters: {'id': '538076fac1654380b1207d24544fe31d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:33.909493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 23:09:33.911336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:33.913328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 249/478] 10.222.0.88 () {60 vars in 1131 bytes} [Mon Aug 29 23:09:33 2022] POST /identity/v3/roles => generated 144 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:33.917187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:34.039151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:34.074892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650c4ed-57b0-4058-86b5-60d6207d3539 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:34.131718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637d78a-99d2-4484-8a87-f88e3b1dd72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:34.132273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637d78a-99d2-4484-8a87-f88e3b1dd72a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:34.132548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637d78a-99d2-4484-8a87-f88e3b1dd72a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:34.132819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637d78a-99d2-4484-8a87-f88e3b1dd72a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:34.153970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637d78a-99d2-4484-8a87-f88e3b1dd72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4637d78a-99d2-4484-8a87-f88e3b1dd72a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:34.158780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:34.160821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:34.162767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 230/479] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:09:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:34.165985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:34.284701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30d8ed-b28b-4799-a1d3-395c4b3ab4f9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:34.308647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:34.320775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:34.321423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:34.321736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:34.323011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:34.323612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:34.323925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:34.325355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50496e-2af5-4cbb-b2e3-cc046822c344 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:34.334698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 250/480] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:34.748307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e77d-0d6f-4359-b210-f4d5c47d5e3a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:34.748806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e77d-0d6f-4359-b210-f4d5c47d5e3a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:34.748880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e77d-0d6f-4359-b210-f4d5c47d5e3a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:34.750478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 231/481] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:34.755579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:34.756007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:34.756317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:34.776978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:34.778181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:34.849643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 251/482] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:35.159009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8e77d-0d6f-4359-b210-f4d5c47d5e3a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:35.291316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8e77d-0d6f-4359-b210-f4d5c47d5e3a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:35.339383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11b8a3-ab3e-4a16-a569-06e5d81109f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:35.340027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b8a3-ab3e-4a16-a569-06e5d81109f0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:35.340307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b8a3-ab3e-4a16-a569-06e5d81109f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:35.340579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b8a3-ab3e-4a16-a569-06e5d81109f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:35.342562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:35.362043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11b8a3-ab3e-4a16-a569-06e5d81109f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9e11b8a3-ab3e-4a16-a569-06e5d81109f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:35.366987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:35.367864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:35.368758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 232/483] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:35.375439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:35.504380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852cff-86f5-4f1e-b797-b823f6728391 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:35.505029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852cff-86f5-4f1e-b797-b823f6728391 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:35.505570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82852cff-86f5-4f1e-b797-b823f6728391 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:35.507942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 233/484] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:09:35.514446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:35.514982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:35.515583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:35.529296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fef59-f01b-4224-9864-e2832e44a723 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:35.536023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:35.537524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:35.554274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:35.599944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:35.600580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:35.600861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:35.601394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:35.601905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:35.602207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:35.604199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:35.620762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 252/485] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:35.622908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 234/486] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:35.630331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:35.737151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61f50e-8e78-4237-a35e-d98a5cc0dce1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:35.772607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:35.773246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:35.773454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:35.773730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:35.787288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:35.788769 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-43a5e587-66b7-4b81-b2b6-a62001df0552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:35.804047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:35.804945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:35.805823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:35.805823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:35.805823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:35.805823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 253/487] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:35.811761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:35.958311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487de5b-90be-4502-b89a-d73854fa9b93 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:35.988678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.001121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e239aac-d6a6-49d7-9e05-36ba86a1d4f4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.001383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e239aac-d6a6-49d7-9e05-36ba86a1d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.001653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e239aac-d6a6-49d7-9e05-36ba86a1d4f4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.001745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.002317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.002592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.002865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.003294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 254/488] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:36.003507 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:36.003807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:36.005251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:36.011535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712ff0-b58e-48bc-876f-f3f040c18301 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.011824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712ff0-b58e-48bc-876f-f3f040c18301 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.012094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712ff0-b58e-48bc-876f-f3f040c18301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.028180 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 235/489] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:36.034076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.038383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4f712ff0-b58e-48bc-876f-f3f040c18301 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:36.039791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4f712ff0-b58e-48bc-876f-f3f040c18301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:36.066520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.114252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 255/490] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:36.115835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652758c-ba9a-416f-9578-4ee88300b786 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.116123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652758c-ba9a-416f-9578-4ee88300b786 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.116395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652758c-ba9a-416f-9578-4ee88300b786 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.122111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 256/491] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:36.122111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652758c-ba9a-416f-9578-4ee88300b786 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.164964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076d4d-3ccc-4b98-afff-049a549133dd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.201551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.202446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.202446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.202716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.210694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:36.212140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-049bc4cb-df65-417f-b2ef-ed6813ff764d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:36.225740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:36.226688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:36.227567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 236/492] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:36.229428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.229428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.229594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.250476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:36.251742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:36.259282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652758c-ba9a-416f-9578-4ee88300b786 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.295594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.305028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.306757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.307374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.308019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.321065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:36.326645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 237/493] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:36.327225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:36.328074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:36.328866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:36.329501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.332111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 257/494] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:36.338830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.363214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.447937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc3b8a-6090-4263-b797-33cfe30774f2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.468643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567e93-601a-4f75-87a7-3d83e1d4ae44 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.497739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.498362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.498772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.499053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.499786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:36.500337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:36.501660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:36.511941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.512830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.513350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.513820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.515662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:36.516166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:36.517772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:36.527768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 258/495] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:36.528817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.549594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 238/496] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:36.550508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.590536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.642278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.669358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de0be-3f27-48bd-bc36-b5cd71d2d472 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.678669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd2f64-c8f7-4b69-a484-f508b46474b6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.704817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.705501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.705804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.706124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.716223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.716856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.717147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.717431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.717927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:36.723203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:36.724072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:36.724849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 259/497] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:36.726550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.732692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:36.734202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:36.750262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:36.751175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:36.752032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:36.752032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:36.752032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:36.752032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 239/498] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:36.752738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.835925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c27a2-4413-437c-a140-fc9b634f9b5c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.842756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.862055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f31f0-f983-496a-8011-f39f18126dad None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:36.874819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.875429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.875709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.875979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.887866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:36.897940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:36.898560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:36.898838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:36.899103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:36.910314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:36.916074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:36.916953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 240/499] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:36.922372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:36.954320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:36.955913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.030993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107d8a7-5e72-4048-b86a-6dc76ea0232a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.064589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.065214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.065491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.065762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.066417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.066722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.066966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 260/500] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:37.067884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.068168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.076075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 241/501] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.076860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.088304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.113482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.172240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3287f7-621b-4550-85b8-64eb5d1a7402 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.178931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72798f-2e17-4638-b32f-79628b627839 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.206109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.206712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.206996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.207272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.207910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.208216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.209617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb0257-ac39-464c-a327-8c1c33dd0f62 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.213501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.214096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.214374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.214646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.215300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.215599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.216965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.221071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 261/502] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.222303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48e31-c4d0-4828-bd47-a94902a0a1a1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.222591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48e31-c4d0-4828-bd47-a94902a0a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.222867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d48e31-c4d0-4828-bd47-a94902a0a1a1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.224057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 262/503] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:37.224767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48e31-c4d0-4828-bd47-a94902a0a1a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.232815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 242/504] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.232815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.295852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.326666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.329707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e3501-f29c-4300-8dc8-3bf3c1e780d8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.331151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d48e31-c4d0-4828-bd47-a94902a0a1a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.363112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.363669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.363797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.363949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.364284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.364417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.364698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.364972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.375416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.375622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.376941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.377060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:37.391176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:37.392325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:37.393446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:37.393446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:37.393446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-095bb6a2-0184-45dc-aba1-79087fcaea78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:37.393627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:37.394401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:37.395259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:37.395259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:37.395259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:37.395423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 243/505] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:37.395496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 263/506] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:37.395562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.395627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf239-008a-470f-87f7-586d05188ade None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.395627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf239-008a-470f-87f7-586d05188ade None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.395627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cf239-008a-470f-87f7-586d05188ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.415498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-296cf239-008a-470f-87f7-586d05188ade None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:37.417265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-296cf239-008a-470f-87f7-586d05188ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:37.484543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 264/507] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:37.485628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf239-008a-470f-87f7-586d05188ade None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.510788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b622182-54d9-4924-98b6-1a4ba38324a7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.532065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.547746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.548595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.548865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.549169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.558019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.559475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:37.570438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:37.571509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:37.573212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 244/508] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:37.576864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.577696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.599874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cf239-008a-470f-87f7-586d05188ade None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.637801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.638651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.638760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.638949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.648786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.650893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:37.665141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:37.666203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:37.667064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:37.667064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:37.667064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:37.667064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 265/509] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:37.667064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.691925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075b39-d57f-44c7-8b9b-4634a86964b3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.729273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.730025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.730201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.730431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.731079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.731385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.732759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.745391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 245/510] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.750275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.769666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5e0c-7de2-4d6c-80d6-baf6d62e0e0c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.792506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.804256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.804862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.805163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.805440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.806119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.806529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.807896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.809314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:37.820736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 266/511] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.821562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.850383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aa0bb-b61e-4a75-8fbc-b3d12cd4d019 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.883870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.884978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.885336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.885612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.886334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.886640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.888084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.905189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 246/512] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.905991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:37.924981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e66ffd-e59c-4dae-b3fe-5fb5e353ba5e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:37.959623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:37.960227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:37.960511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:37.960786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:37.961472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:37.961774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:37.963408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:37.974735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 267/513] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:37.975494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.000453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.004747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3364f45-fbe0-4787-adaa-8f77e3db2451 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.031736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.039560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.040191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.040533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.041014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.047999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.049489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:38.061649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:38.062725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 247/514] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:38.063888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.080546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05228e-6795-4c59-9638-0ce5384489cc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.114996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.115748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.116124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.116478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.127053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.128583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:38.142560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:38.143648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:38.144503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:38.144503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:38.144503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:38.144503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 268/515] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:38.144503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.164496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc38ccd-7a8a-41d7-91f7-05fa1c7bf22e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.198505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.199141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.199424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.199696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.206474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.207729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:38.220818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:38.221874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 248/516] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:38.222851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.242632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.249400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3f09a-8036-4f84-a4a0-c79ab6bdcf77 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.256963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.285774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.286367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.286644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.286917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.323536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e52db5-fd4d-43b3-9bc4-9b34e867c4f9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.355334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.356465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.356812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.357091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.357404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.357680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.364971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.366469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:38.377540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:38.378481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:38.379355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 249/517] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:38.379917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.461409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.463279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 269/518] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:38.464609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.475718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.485597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51936d-0484-4d73-bad9-c8b3533efa14 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.519140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.519745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.520026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.520300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.521027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:38.521365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.522802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.540989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 250/519] 10.222.0.88 () {56 vars in 1139 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:38.541928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.573097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bebaf0-d7a3-4528-b4c3-484d0ec68316 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.610137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.610745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.611023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.611306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.611947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:38.612281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.613708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.625268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 270/520] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:38.626091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.646365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da90ff-0c0d-481e-8488-d5d922a54f22 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.680575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.681759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.682036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.682316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.682998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:38.683300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.684730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.689072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.700303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.704342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 251/521] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:38.705263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.739743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d8f53-2031-467c-ad4a-cfb8d82c4bfc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.772844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.773578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.773855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.774135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.775625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:38.775927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.777421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.803816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cdaee-8833-4f5d-83aa-f68b9b26247b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.813091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 271/522] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:38.813932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.839060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.839690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.839974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.840247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.850120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:38.851609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:38.867702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:38.868778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:38.870610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:38.870610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:38.870610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:38.870610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 252/523] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:38.870610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:38.916565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867da53c-27d1-419f-a5b0-edf72dd9bcee None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:38.918368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.940636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:38.951930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:38.952528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:38.952802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:38.953069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:38.970467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4bdcc-def0-4b14-8fd9-d03e16c8a119 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.003493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.004016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.004291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.004560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.005220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.006644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.020405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.022001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.027959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 253/524] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:38 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:39.028772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.138230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 272/525] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:39.139460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.154985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4ae44-ea10-4b31-969f-40c78534cd2f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.157651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.170906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.198703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.199314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.199605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.199884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.200618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=ece70bdb48004d8bb17968453f12a6da) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:39.200928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.202413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.209250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 254/526] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/role_assignments?user.id=ece70bdb48004d8bb17968453f12a6da&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:39.209975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.271193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ff966-f9c6-4ebe-91d0-a411ea8a0cc0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.315331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.316249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.316672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.317208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.339339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee6be9-0f3a-4e9b-9386-fa163b56026f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.375624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.376277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.376540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.376818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.378285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:39.378285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.379577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.391840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 255/527] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:39.392683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.407172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.409226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.427411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.440566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.529334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 273/528] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:39.529334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.540939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94743060-e826-4a8b-8c7f-8ed8487a1e40 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.593790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.595156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.595689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.596112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.609679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.612018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:39.633000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:39.634262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:39.635827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:39.635827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:39.635827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:39.635993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e3e5a-224c-48e6-87fa-654acb319a07 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.638425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 256/529] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:39.639467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.671054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.683759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.684581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.684962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.685392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.693278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.694870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:39.707531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:39.708585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:39.709682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:39.716857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 274/530] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:39.717839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.738853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.766767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca299e-a207-4457-8b41-21f87b91790c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.806075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.807159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.807606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.808021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.819728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.821474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.831882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6117a-e14f-4d60-a518-54617e8c5c25 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:39.838259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:39.839566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:39.840626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:39.840626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:39.840626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:39.846907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 257/531] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:39.848030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.871603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:39.872388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:39.872770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:39.873226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:39.874174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:39.874348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:39.875968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:39.894235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 275/532] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:39.895060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:39.943417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:39.963676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595ad32-d99d-46fa-b779-1074a85d0946 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:39.997344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:40.001296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d91a77-b690-4bca-ab26-14038250728e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.004497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.005314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.005741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.006158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.006988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:40.007456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.009037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.023310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 258/533] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:40.024404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.044981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.045634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.045965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.046281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.046921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:40.047223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.048652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.065333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 276/534] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:40.065333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.155724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b6170-8967-4fb5-a46d-d824ca953fb8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.196070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908abb0-6715-4af8-8471-fb0e75ce19cd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.200156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:40.200522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.202149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.202436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.202711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.211601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.214807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:40.232151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:40.233244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:40.234083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:40.234979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 259/535] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:40.236745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.243738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.244557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.244971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.245425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.246292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=1cda9da215144c6ca429f8787be283f8) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:40.246764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.248378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.261138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 277/536] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/role_assignments?user.id=1cda9da215144c6ca429f8787be283f8&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:40.261138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.352130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:40.484389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29d04d-6266-4731-b37a-73716ed8ef4b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.492333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785244f-e8ce-4052-8205-c8ec0303a622 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.531748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.532422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.532703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.532976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.533745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:40.534050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.535501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.564376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 278/537] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:40.564709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.565244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.565527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.565802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.574575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.598048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.599532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:40.616231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:40.617185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:40.618037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:40.622761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 260/538] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:40.622899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:40.628097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:40.778920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1205-7cc2-45cb-bdf7-aa867f71136f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.850267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ab641-fa66-4974-9a52-a09c39970032 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:40.857625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.861550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.861856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.862131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.862865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=c34d710cbc1e474aa98bf4e2c9cf9374) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:40.863173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.864623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.879093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 279/539] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/role_assignments?user.id=c34d710cbc1e474aa98bf4e2c9cf9374&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:40.892156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:40.909039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:40.909705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:40.909989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:40.910267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:40.910967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:40.911273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:40.912750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c12b5-c373-4dca-bf77-4c7d435940a4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:40.947770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 261/540] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:40.953600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:41.077587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:41.086124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b125a-a6b6-4fe8-b88b-34867b2718f8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:41.122303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:41.123060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:41.123440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:41.123813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:41.124655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=016885b1849e4e3d990c3de23c479399) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:41.125064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:41.126606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c660d0-e2dc-47c0-8649-b8af8878e053 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:41.132850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 280/541] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:40 2022] GET /identity/v3/role_assignments?user.id=016885b1849e4e3d990c3de23c479399&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:41.178823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54da8a-dab6-4727-8749-461b9db98439 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:41.179367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54da8a-dab6-4727-8749-461b9db98439 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:41.179367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54da8a-dab6-4727-8749-461b9db98439 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:41.180775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 262/542] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:41.186852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c554a-9f51-4a90-a1a1-f0452e92e90c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:41.187149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c554a-9f51-4a90-a1a1-f0452e92e90c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:41.187433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c554a-9f51-4a90-a1a1-f0452e92e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:41.207554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ae3c554a-9f51-4a90-a1a1-f0452e92e90c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:41.208775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ae3c554a-9f51-4a90-a1a1-f0452e92e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:41.317155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 281/543] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:41.481183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f953b5-3cc5-4bd9-90e8-5e68251478df None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:41.481509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f953b5-3cc5-4bd9-90e8-5e68251478df None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:41.481793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f953b5-3cc5-4bd9-90e8-5e68251478df None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:41.483404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 263/544] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:41.488577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:41.488875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:41.489195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:41.511885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:41.513149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:41.597892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 282/545] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:41.675182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f953b5-3cc5-4bd9-90e8-5e68251478df None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:41.788953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f953b5-3cc5-4bd9-90e8-5e68251478df None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:41.832799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:41.833463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:41.833743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:41.834018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:41.845478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:41.850347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:41.851226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:41.853658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 264/546] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:41.858179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:41.917471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:41.980951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee83e03-d01a-4aff-a796-44ca57a6ec1d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.026444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.027064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.027349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.027629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.028301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:42.028604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:42.030008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:42.043287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 283/547] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:42.048663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.069883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.105511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:42.205421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe7c84-a01e-43f5-a2e9-3ec3bbef80af None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.237491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:42.279643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bc9e5-4ceb-4334-be6e-67a5141dcfe1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.291266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.291266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.291614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.292012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.318957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.319519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.319802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.320074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.321977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:42.323650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:42.334196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:42.340675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:42.341626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:42.343480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 284/548] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:42.348921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:42.363440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:42.364918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:42.366002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:42.366002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:42.366002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:42.373552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 265/549] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:42.382098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.467605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40d599-3c55-41fc-9fa2-286139c0c1ab None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.508186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.508807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.509252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.509624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.510585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:42.510898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:42.512287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:42.536620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 285/550] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:42.537446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:42.543625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.679341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75453e66-cd17-4b69-8fe9-8a4529490acc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.721483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:42.725815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c112a-e848-47ea-95fe-f07b7d79c2a5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.726807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.727585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.727872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.728240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.741903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:42.743581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4254749c-5a5c-4e64-8a68-60f32530bb7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:42.761350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:42.762335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:42.763327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:42.763327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:42.763327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:42.763327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 286/551] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:42.763982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652025-5dc8-45c7-83fb-050fd151fd7f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.765014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652025-5dc8-45c7-83fb-050fd151fd7f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.765014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8652025-5dc8-45c7-83fb-050fd151fd7f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.771525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 287/552] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:42.772802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652025-5dc8-45c7-83fb-050fd151fd7f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.788547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.791161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.791449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.792117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.792944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:42.793378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:42.794872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e58d1-901e-40db-9a34-bfa84418a786 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:42.808316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 266/553] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:42.809897 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.810301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.810694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.830930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:42.832295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:42.861525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:42.906245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8652025-5dc8-45c7-83fb-050fd151fd7f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:42.913239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 267/554] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:42.914330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:42.942542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:42.943201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:42.943758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:42.944267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:42.945084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:42.945621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:42.948112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:42.960943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 288/555] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:42.967383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.074506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732488b3-9a6a-412d-bc67-b6c4cf5adfe3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.095990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.117466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.141586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.143514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bdc1d-d777-44c4-977c-6b5829844a7f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.145439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.145722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.145998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.161659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.163341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:43.186943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:43.187904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:43.188804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:43.191637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 289/556] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:43.196016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.209863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.211061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.211510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.211929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.221541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.223330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e7b4766f-9c1b-4c5a-af90-0905abf00756 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:43.237486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:43.239227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:09:43.240356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:43.242383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 268/557] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:43.249947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc446-c44a-45ed-a417-0446806cb51b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.250592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc446-c44a-45ed-a417-0446806cb51b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.251123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1dc446-c44a-45ed-a417-0446806cb51b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.253366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 269/558] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:43.254292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc446-c44a-45ed-a417-0446806cb51b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.339402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833c29d-cc3e-4dda-80ca-a2ed78400dda None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.373690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508598df-e184-4948-8486-f9453ea86813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.374293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508598df-e184-4948-8486-f9453ea86813 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.374572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508598df-e184-4948-8486-f9453ea86813 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.374843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508598df-e184-4948-8486-f9453ea86813 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.375558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508598df-e184-4948-8486-f9453ea86813 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:43.375858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508598df-e184-4948-8486-f9453ea86813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.377327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508598df-e184-4948-8486-f9453ea86813 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.379018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1dc446-c44a-45ed-a417-0446806cb51b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.398396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 290/559] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:43.398396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.398396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.398396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.414547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:43.416212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:43.421512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.422119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.422389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.422662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.423381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:43.423681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.425161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.427397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.444580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.448450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 270/560] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:43.448450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.498126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 291/561] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:43.498862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.585319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb7f1f-f376-453f-883e-80a50cebbf85 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.610551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417640-07ac-40c1-badf-e40a513c12e8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.627745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.628547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.629141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.629418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.643632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:43.645815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.646463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.646742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.647008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:43.648452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:43.649385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:43.651262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:43.651898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 271/562] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:43.652517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.662964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.664413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-300f4a18-3f25-41fc-9c59-1ceedecc684e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:43.679419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:43.680339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:43.681371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:43.681371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:43.681371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:43.681371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 292/563] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:43.682161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b04f-a0be-495b-b293-506345602827 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.682161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b04f-a0be-495b-b293-506345602827 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.682461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2b04f-a0be-495b-b293-506345602827 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.683675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 293/564] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:43.688428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b04f-a0be-495b-b293-506345602827 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.702881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.720679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.770962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a09d2-0a78-4da7-9a44-b8b23ac865a2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.798999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2b04f-a0be-495b-b293-506345602827 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.809288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4f75-f58c-4b8f-9a96-9ee0a5d8069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.809892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4f75-f58c-4b8f-9a96-9ee0a5d8069b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.810172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4f75-f58c-4b8f-9a96-9ee0a5d8069b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.810574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4f75-f58c-4b8f-9a96-9ee0a5d8069b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.832719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.833345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.833625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.833904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.834558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:43.834858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.836223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.844664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 294/565] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:43.845610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:43.879419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4f75-f58c-4b8f-9a96-9ee0a5d8069b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.880909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4f75-f58c-4b8f-9a96-9ee0a5d8069b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:43.925265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.932514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:43.953632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb895a7-08db-4e85-b06a-10a2cecbc752 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:43.980863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 272/566] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:43.982395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.982824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.983243 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.986844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:43.987450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:43.987730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:43.988003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:43.988647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:43.989006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:43.990455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.001296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:44.002479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:44.002731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 295/567] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:44.003533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.074090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 273/568] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:44.075229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.115218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2c02-fe82-4f13-b4db-d612056bf6f9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.152011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.152639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.152921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.153218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.155644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.159200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.165825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:44.170760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.171664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:44.172515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 296/569] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.173215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.185687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e92f0-59f8-4c4c-8654-9aee64386d75 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.225568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.226288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.226576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.226851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.237706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.239132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:44.256080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.257029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:44.258302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:44.258302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:44.258302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:44.258835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 274/570] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.260337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.285494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5333f-6440-48a9-ade1-7e3900a0dc30 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.326523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.327810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.328235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.329177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.344317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.346243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:44.360930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.362097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:44.363252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:44.363252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:44.363252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:44.363252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 297/571] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.363252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.363570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d1022-d77b-4856-9370-b9bcf6d17f3d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.398710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.399320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.399581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.400733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.402621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.408356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.409848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.411171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:44.421087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 275/572] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.423229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.467542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8231e-07bf-4bf5-9112-353e236a9099 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.502168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.502765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.503043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.503313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.503970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:44.504290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.505677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.514372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 298/573] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:44.514991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.532254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd65e9-ed4f-46ee-aac9-4f8e8b6fbd24 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.565364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.565967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.566248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.566521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.567165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:44.567466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.568839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.581177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 276/574] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:44.581980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.614587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c8b04-d16c-4a07-8dd2-64b25281f772 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.623930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.639234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.649755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.651106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.651487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.651768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.661856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:44.667936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.669006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 299/575] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.670287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.688425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39de1d-c510-4ef6-8102-57fcc65b3f0a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.724114 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.724644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.724923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.725230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.725869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:44.726168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.727551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.738838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 277/576] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:44.739628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.779651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe4198-4ccc-49d4-b300-1fa9db8ef500 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.813018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.813659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.813941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.814219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.814909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:44.815214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.816673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.828584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 300/577] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:44.829408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.843861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb106b-cf2e-4ec2-81ab-ecfa3fce7cb5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.857329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.859222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:44.878616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.879242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.879528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.879789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.890473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.891921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:44.906452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.907579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:44.908663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:44.908663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:44.908663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:44.912134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 278/578] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.913013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:44.934309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc5fc8-61c5-42bd-b611-2e67b082a82b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:44.969351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:44.969977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:44.970259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:44.970533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:44.977416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:44.979642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:44.991315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:44.992334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 301/579] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:44.993336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.019191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f429e-7845-44d5-8b1b-85fc15b11b2e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.054043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.054642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.054921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.055192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.055851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:45.056285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.057969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.065691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 279/580] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:45.066455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.081595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.094885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5a3ae-4d1a-4d6a-ba83-606a5a979068 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.096757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.130072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.131008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.131290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.131569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.138602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.140056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:45.152119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:45.153472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 302/581] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:45.155174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.175020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84186465-ded7-4eeb-9ebf-51a8f7ac4daf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.207953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.208606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.208884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.209185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/ece70bdb48004d8bb17968453f12a6da/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.223682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=ece70bdb48004d8bb17968453f12a6da, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.225151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.244096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 280/582] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:45 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/ece70bdb48004d8bb17968453f12a6da/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:45.244096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.254321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96489998-3fd8-4ddd-bbf3-d5c3abb19624 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.296805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.297474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.297755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.298025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.298757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:45.299062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.300501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.317184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 303/583] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:45.317386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.329924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.352805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.381463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05c6e4-437b-484e-b816-199711f71ed4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.424291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.424909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.425228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.425506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.426711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:45.427075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.428529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.438688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4704c-a3d7-462b-b27f-68ef49884cbb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.447846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 281/584] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:45.448993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.480220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.480874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.481181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.481656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.491903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.493398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:45.509214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:45.511001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:45.511997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:45.511997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:45.511997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:45.511997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 304/585] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:45.511997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.561279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5c58b-9a16-491d-850f-aa5fbfd7c3a4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.581275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.597704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.598452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.598799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.599696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.599807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:45.600062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.601517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.605013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.615268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 282/586] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:45.615864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.637985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e104007-a6eb-42e9-bb03-302bb78c2e16 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.673651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.674289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.674573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.674849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.683367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.684808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:45.696324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:45.698674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 305/587] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:45.699806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.731664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f35bd-2a27-45c5-8271-93d924a35fc8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.769152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.769708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.769992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.770271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.782745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.784853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:45.801739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:45.802727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:45.803675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:45.803675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:45.803675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:45.803675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 283/588] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:45.803675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.813834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de531e2-aef5-4882-9ed7-886b4cda6653 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.836263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.852577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.854045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.854158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.854444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.855123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:45.855390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.856759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.860642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:45.871183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 306/589] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:45.871803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.920739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29546e-2aba-4124-8b0a-08ee741e563d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:45.956308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:45.956910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:45.957219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:45.957497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:45.958267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=a740dffa48ae44edb8f2a103bd8203c5) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:45.958532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:45.959959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:45.966372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 284/590] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/role_assignments?user.id=a740dffa48ae44edb8f2a103bd8203c5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:45.966372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:45.994311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b3838-fa45-4913-a6a2-77723cc64cbf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.032467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.033203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.033484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.033754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.034577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:46.035047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.036536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.069574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 307/591] 10.222.0.88 () {56 vars in 1139 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:46.070583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.103925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2db779-2621-43f1-8e4c-c508fda0293c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.126390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.131665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.158923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.159529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.159803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.160075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.160715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:46.161011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.162442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.180023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 285/592] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:46.181588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.217644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46207-1315-4a0b-aa46-7c313ef82a7f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.267092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.267728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.268005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.268271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.279373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.280842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:46.293595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:46.294549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:09:46.295476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:46.299518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 308/593] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:46.300251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.303136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086a76b-0bd8-4ebc-8203-9fbcaec97fcf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.354728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.356120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.356607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.357136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.372026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.374712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:46.395882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:46.396883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:46.397811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:46.397811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:46.397811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:46.404246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 286/594] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:46.404246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.412736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.420046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9201993c-cc06-4d5b-a6fd-e3a70e7f5dfc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.435926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.468263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.469674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.470397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.470858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.480974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.482884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:46.497885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:46.498807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:46.499683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:46.502316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 309/595] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:46.503511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.533288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820c628-b8b2-4fdd-a5c0-aead3fa845f1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.576435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.577670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.578024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.578600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.579311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:46.579893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.582085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.609218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 287/596] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:46.610120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.642989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8469214-67ed-422c-9d15-2226fdd56228 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.688760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.689695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.689977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.690496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.691546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:46.691858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.693610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.711416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 310/597] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:46.712887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.717947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.741444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:46.743511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc1015-c1c6-43bc-9c04-c3d499d8f679 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.783124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.783736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.784016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.784290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.784984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:46.785333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.786838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.799589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 288/598] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:46.800426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.861259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cd41c-d2c6-4522-8dae-41e7360fad62 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.910519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.911415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.911696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.911973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.916152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeab248-627b-48f7-8c6b-a719eab09e05 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:46.926045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.927982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:46.951196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:46.953330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:46.955503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:46.955503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:46.955503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:46.955503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 311/599] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:46.955503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.961883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:46.962562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:46.962840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:46.963135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:46.970744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:46.972265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:46.984645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:46.986431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 289/600] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:46.988026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:46.993262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:47.038841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:47.074462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3edb6-64d4-4219-be06-482ebf2403f1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.104768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765388bc-ab29-498b-aa7a-88cf51702165 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.112294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.113470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.113953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.114426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/1cda9da215144c6ca429f8787be283f8/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.132493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=1cda9da215144c6ca429f8787be283f8, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.135605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.145619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.146706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.147102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.147494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.148512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:47.148917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.151197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.151933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 312/601] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:46 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/1cda9da215144c6ca429f8787be283f8/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:47.153390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:47.168145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 290/602] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:47.173775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:47.289529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:47.309010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608a807-6d46-4963-9916-691f6c616732 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.335256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:47.351131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12365da-97d8-4486-8ec8-735fada31b83 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.352978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.353624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.353902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.354182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.354882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:47.355190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.356635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bfc76-af33-483f-be2b-5f725f11d653 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.368464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 313/603] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:47.369934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c92e-a766-481f-81e1-fc8198392cda None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.370223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c92e-a766-481f-81e1-fc8198392cda None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.370497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821c92e-a766-481f-81e1-fc8198392cda None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.371895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 314/604] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:47.374611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821c92e-a766-481f-81e1-fc8198392cda None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:47.404924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.405929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.406550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.407011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.416769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.419293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-573ad029-dd71-4896-b3be-469ade206968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:47.435681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:47.436651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:47.437613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:47.439864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 291/605] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:47.441794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.442524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.442953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.466855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:47.468613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:47.505427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821c92e-a766-481f-81e1-fc8198392cda None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.546570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.547445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.547629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.548023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/c34d710cbc1e474aa98bf4e2c9cf9374/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.560405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 292/606] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:47.561805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:47.565644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=c34d710cbc1e474aa98bf4e2c9cf9374, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.567361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.584670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 315/607] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:47 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/c34d710cbc1e474aa98bf4e2c9cf9374/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:09:47.637909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:47.693766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5df26e-5c06-43c7-897e-d4d89f0f6684 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.733596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.734534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.734982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.735407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.736264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:47.736719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.738390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d037663-784d-45d4-89f4-b0e6ade2eae3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.752583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 293/608] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:47.760874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:47.818905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:47.903513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45930c0-7b56-423b-8a56-f0687243e60a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:47.943035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:47.943708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:47.943988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:47.944266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/016885b1849e4e3d990c3de23c479399/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:47.961343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=016885b1849e4e3d990c3de23c479399, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:47.963729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:47.978424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 316/609] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:47 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/016885b1849e4e3d990c3de23c479399/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:48.045783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922560-7b11-4956-889c-10634a9ee127 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:48.046110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922560-7b11-4956-889c-10634a9ee127 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:48.046345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922560-7b11-4956-889c-10634a9ee127 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:48.047825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 294/610] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:48.048747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:48.054583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:48.054895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:48.055182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:48.077762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:48.081146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:48.211044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 295/611] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:09:48.217878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:48.240148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91232a40-b592-4607-8c7d-64841331df44 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:48.278756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:48.279407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:48.279696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:48.279973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:48.294009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:48.298997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:48.299944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:48.300813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 317/612] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:48.305948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:48.378133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:48.468946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7ecde-7276-427b-9b0c-69e99c2f31bf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:48.520786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30921b-db15-4b69-8344-72329a754339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:48.521435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30921b-db15-4b69-8344-72329a754339 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:48.521713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30921b-db15-4b69-8344-72329a754339 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:48.521990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30921b-db15-4b69-8344-72329a754339 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:48.522662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30921b-db15-4b69-8344-72329a754339 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:48.522966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30921b-db15-4b69-8344-72329a754339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:48.524343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30921b-db15-4b69-8344-72329a754339 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:48.533837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 296/613] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:48.539543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:48.572534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30921b-db15-4b69-8344-72329a754339 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:48.719832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d485-50e6-4776-bf8d-aa2ff0573ab3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:48.780518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:48.781198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:48.781484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:48.784350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:48.801527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30921b-db15-4b69-8344-72329a754339 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:48.803256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:48.806901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:48.810006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:48.811615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:48.840667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:48.841704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:48.842577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:48.842577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:48.842577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:48.852402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 318/614] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:48.854670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:48.855313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:48.855594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:48.855865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:48.856824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:48.881543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:48.889689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:48.891781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:48.893816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 297/615] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:48.902524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.027791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b782761-ff99-4416-afcd-4079fa11f053 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.068530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.069272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.069557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.069831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.070474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:49.070775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.073016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.086298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 319/616] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:49.092566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.099228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe394e-371a-4a6d-b90d-0fc316aa24a9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.152304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:49.173810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.174430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.174709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.174979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.175646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:49.175941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.177333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.186647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 298/617] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:49.191920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.227141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:49.243044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1f89-eda1-422f-9dd2-6626fe9bda72 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.309259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e999d11-c5fa-4b88-a0a9-558e76cd0ab9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.317971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.318990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.319472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.319943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.329767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.331593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ff19fad5-dcab-4986-b029-a0f6e804df45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:49.344106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:49.345076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:49.346102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:49.348665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 320/618] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:49.350240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab90be-c566-40e4-8cca-1c438da809c3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.350661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab90be-c566-40e4-8cca-1c438da809c3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.351064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab90be-c566-40e4-8cca-1c438da809c3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.352659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 321/619] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:49.357960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab90be-c566-40e4-8cca-1c438da809c3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.362911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.363659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.364039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.364411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.377191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.379266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f0ae198e-8a5d-4395-9ebd-5ae4bbb4c8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:49.398099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:49.399256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:49.400624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:49.400624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:49.400624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:49.400624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 299/620] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:49.406811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.407309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.409553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.434787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:49.436753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:49.480291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab90be-c566-40e4-8cca-1c438da809c3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.513465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:49.517272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.517890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.518174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.518486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.519226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:49.519538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.520906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 300/621] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:49.521972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.533427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.533999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:49.573304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 322/622] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:49.578651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.639439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db9cad-1c81-4713-baba-b5ab8875ca35 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.682929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.686667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.687129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.688255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.689077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:49.689756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.693464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.716977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 301/623] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:49.720223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:49.790459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55e7e2-4c5f-4436-9125-b6520e9cebfa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.839139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:49.857371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a907b-4b91-4b7c-85f4-1aee75ef4efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.858339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a907b-4b91-4b7c-85f4-1aee75ef4efb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.858795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a907b-4b91-4b7c-85f4-1aee75ef4efb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.859240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a907b-4b91-4b7c-85f4-1aee75ef4efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.899215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d16521-08d3-4e88-9146-2a45683b916c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:49.934176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:49.954276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:49.954916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:49.955183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:49.955484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:49.962742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a907b-4b91-4b7c-85f4-1aee75ef4efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.963596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:49.964321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a907b-4b91-4b7c-85f4-1aee75ef4efb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.965380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:49.977314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:49.978652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:09:49.980028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:49.982214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 302/624] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:09:49.983035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.071229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 323/625] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:50.073308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c9d4-c0aa-491b-8010-5dfb94e74297 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.073686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c9d4-c0aa-491b-8010-5dfb94e74297 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.074033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27c9d4-c0aa-491b-8010-5dfb94e74297 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.077151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 324/626] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:50.077151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27c9d4-c0aa-491b-8010-5dfb94e74297 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.098351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04bf68-e58e-4f76-b689-3b15460112a1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.127784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.136616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.137285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.137563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.137834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.148338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:50.154691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:50.155644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:50.156499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 303/627] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:50.157230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.162231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.195943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27c9d4-c0aa-491b-8010-5dfb94e74297 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.232166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.232767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.233044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.233340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.234061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:50.234359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.235786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540e84b-ba60-4f02-9968-56ef70468743 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.255012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 325/628] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:50.261360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.261645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.261918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.262601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352544b7-f43f-44f0-9755-eedbcf8f2628 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.279410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:50.280588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:50.298997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.299633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.299933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.300185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.311644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.313121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:50.327944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:50.329133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:50.330183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:50.330183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:50.330183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:50.330183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 304/629] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:50.330183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.354629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 326/630] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:50.356166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.375762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.440781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e61c7-1ab0-42bf-b401-3f84fe9726ac None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.444936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.479032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.479774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.480166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.480443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.481373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:50.481696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.483726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.491642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c19d7b-167f-40ae-a276-e693974a35c4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.501630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 305/631] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:50.501630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.530437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.531070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.531348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.531615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.542793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.544650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1d9d9aec-5e85-4bdc-a4a6-ace7f5f9ee09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:50.561757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:50.562692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:50.563614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:50.563614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:50.563614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:50.565897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 327/632] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:50.567275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d086a0a-e92e-4d4c-9590-5f0d44def657 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.567777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d086a0a-e92e-4d4c-9590-5f0d44def657 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.568273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d086a0a-e92e-4d4c-9590-5f0d44def657 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.569980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 328/633] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:50.570872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d086a0a-e92e-4d4c-9590-5f0d44def657 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.614317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02e225-80a6-4871-81db-a2157cb0e0ee None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.615742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.653875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.654489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.654771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.655047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.655686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:50.655988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.657382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.669650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 306/634] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:50.670629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.689780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d086a0a-e92e-4d4c-9590-5f0d44def657 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.700436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.724649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.725320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.725602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.725876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.736243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.737795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-29af0425-7b25-46c1-ba06-40e774e13cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:50.752981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:50.754167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:50.755050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:50.755050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:50.755050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:50.755050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 329/635] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:50.755676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.755955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.756228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.773616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:50.775580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:50.777902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13485008-aa75-4bea-80e9-bf5bb4299137 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.812432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.813047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.822537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.822847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.823504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:50.823815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.825226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:50.839870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 307/636] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:50.840767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.844813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 330/637] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:50.845800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:50.866819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.941028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:50.951174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd77e8-dde2-40e7-a94d-caa435dce26a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.954482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdfa0-1da5-4b19-984d-f0c689d98f96 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:50.987458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.988090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.988408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.988626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.989749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:50.990494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:50.990869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:50.991248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:50.995392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:50.996840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.002051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:51.007364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:51.008503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:51.009592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:51.010533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:51.011521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:51.012599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:51.013856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 308/638] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:51.013968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 331/639] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:51.017140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.017267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.115687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.124874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00012269-a936-4924-bff4-3e80aed91cd1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.137442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876b3ee-8f67-4b0d-a631-481599afe68f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.160771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.161422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.161708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.161984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.169454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.171036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.171813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.172412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.172691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.172963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.173634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.173929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.175289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:51.183117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:51.184133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 332/640] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:51.185129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.192410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 309/641] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:51.193605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.203091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.287656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8d0e2-fe89-4e9a-b000-a3883e395e8f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.292271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26307141-85a6-4c6d-93a4-7fc3205e0f25 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.320928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.321606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.321911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.322190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.322874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.323177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.324616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.326086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.326687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.326970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.327242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.327903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.328207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.329609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.336339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 333/642] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:51.337364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.342161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 310/643] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:51.343075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.346561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.408040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.438170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3c68d-ef39-4751-8112-faa1a4f25915 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.444555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5969e-a7fb-4dad-8de5-1b458e646f17 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.471958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.472590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.472873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.473200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.479488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.480098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.480383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.480660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.481371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.481675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.483107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.483839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:51.488795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:51.489938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:51.490917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 334/644] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:51.491673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.501906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 311/645] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:51.501906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.563881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.596200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c4fb8-d538-4bab-a834-cc9a61210da3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.602192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd1a3a-69a9-4d08-8c7c-46f2378718fc None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.626820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.632195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.632819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.633097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.633394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.636428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.637032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.637377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.637656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.638374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=ece70bdb48004d8bb17968453f12a6da) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.638683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.640113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.640513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.641985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.645825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 312/646] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/role_assignments?user.id=ece70bdb48004d8bb17968453f12a6da&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:51.646613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:51.654472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:51.655549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:09:51.656563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:51.660484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 335/647] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:51.661365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.760597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33567e-6a3e-4d1e-afdd-d34247562a8c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.784965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17f86-2d9d-4a81-b6ff-1e73add99e04 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.789917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.803264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.804133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.804406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.804676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.816612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.818104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.828160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.828769 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.829043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.829422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.830096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.830391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:51.831747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:51.834592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:51.835590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:51.836492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:51.836492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:51.836492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:51.840683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 313/648] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:51.841269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 336/649] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:51.842075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.842198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:51.904633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:51.947845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0238cc-ac13-4126-a657-41b8545e9dcd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.956036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886294-d83d-4933-b143-55ab0c172d69 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:51.985587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.986252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.986531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.986833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/a740dffa48ae44edb8f2a103bd8203c5/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.994242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:51.995166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:51.995651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:51.996567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:51.997872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:51.998391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.000760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.002383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=a740dffa48ae44edb8f2a103bd8203c5, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.003829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.018266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 314/650] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:09:51 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/a740dffa48ae44edb8f2a103bd8203c5/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:09:52.019107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.036940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 337/651] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Aug 29 23:09:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:52.038303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.064096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.157686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de9e8d-0806-46c1-b777-f8f34db98e8f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.174090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.175233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949cd79-eea0-4986-b43b-48134c624547 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.201671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.202270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.202485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.202753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.215540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.217235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.221627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.222312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.222597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.222871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.223513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:52.223812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.225200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:52.234153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:52.235156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:52.236112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:52.236112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:52.236112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:52.236112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 338/652] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:52.236826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.243262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 315/653] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:52.245245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.348880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.360952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44c875-9769-41e7-a527-d31eca8d2d69 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.369745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4326-e06b-460c-968d-fa3a9a6d34b4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.398112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.398727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.399001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.399324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.400857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:52.401195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.402672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.416927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 316/654] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:52.416927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.425456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.426357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.426866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.427356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.462042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.503921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.505423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.531337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2672f6-25ee-40a9-a19c-ee6ce1bb0e52 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.569064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.570242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.570863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.571310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.580288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.582200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:52.595635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:52.596600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:09:52.597600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:52.599858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 317/655] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:52.600782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.620508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 339/656] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:52.620508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.620797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.684341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.720995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c69ea-48f4-4eeb-b81c-b127a2b99c06 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.725029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4fe41-1eba-48b2-8007-1b8a9e335548 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.759478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.760593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.761069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.761575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.764765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.765405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.765687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.765960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.766687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:52.766990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.768416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.771605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.773442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:52.785859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:52.786811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:09:52.787730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:52.788272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 340/657] 10.222.0.88 () {56 vars in 1139 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:52.788272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.790119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 318/658] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:52.792672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:52.877747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.904503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae1bc9-6ba6-49e9-ad26-699f6b4278f1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.912347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e4e99-27fc-4e07-b4e3-0156f0f73558 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:52.929301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:52.942787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.944248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.944690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.945195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.952251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:52.952967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:52.953331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:52.953670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:52.959425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:52.961055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:52.981302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:52.982462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:52.983570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:52.983570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:52.983570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:52.986239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 341/659] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:52.987561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.035965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.037765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.098310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0085443-42b5-4a62-9e34-13ea1a48af8f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.111467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.140319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.141290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.141676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.142360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.143464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:53.143865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.146118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.156149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 319/660] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:09:53.157071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.169318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 342/661] 10.222.0.88 () {56 vars in 1137 bytes} [Mon Aug 29 23:09:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:53.170650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.212845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.268425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1530dcb-8415-425c-b6e2-9e9ff2f22615 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.298605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f712b6-c032-4ef7-85ae-84b9de2ba40f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.303733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.304366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.304636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.304901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.305578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:53.306469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.308121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.320150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 320/662] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:53.320997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.339809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.340440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.340722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.340989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.351705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.353784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.357534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:53.369878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:53.371189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:53.372094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:53.372094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:53.372094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:53.375782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 343/663] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:53.376899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.426291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdfefb-44c4-4910-b208-ecf971310f7a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.460889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33216533-b014-470d-9670-c2872bf16979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.461560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33216533-b014-470d-9670-c2872bf16979 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.461850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33216533-b014-470d-9670-c2872bf16979 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.462162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33216533-b014-470d-9670-c2872bf16979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.464767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.483000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2246f6-b5d7-450b-8fba-8110408277b2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.519224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.520098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.520569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.521019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.528530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.530220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.533433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33216533-b014-470d-9670-c2872bf16979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.534891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33216533-b014-470d-9670-c2872bf16979 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:53.544001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:53.544995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:53.545921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:53.553030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 344/664] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:53.554238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.565359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.640720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 321/665] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:53.641665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33216533-b014-470d-9670-c2872bf16979 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.668460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46eb1-41d8-4238-928c-dc693b8a903e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.707779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.708481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.708883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.709452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.710208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:53.710582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.711963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.729458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 345/666] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:53.730457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.734668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.747348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33216533-b014-470d-9670-c2872bf16979 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.778250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:53.784910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.785555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.785838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.786113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.786804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:53.787108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.788548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.800429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 322/667] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:53.801400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.844006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5176c-00f9-4eb5-9cd6-de704369b8b9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.879675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.880308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.880608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.880868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.891162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.892629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e4dbf9e2-a514-4940-bdaf-dd835546bec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:53.910205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:53.911184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:53.912068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:53.912068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:53.912068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:53.912068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 346/668] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:53.912583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca241a-3520-48ab-97a9-3a2913778a57 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.912735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca241a-3520-48ab-97a9-3a2913778a57 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.913014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca241a-3520-48ab-97a9-3a2913778a57 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.917157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 347/669] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:53.917157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca241a-3520-48ab-97a9-3a2913778a57 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.919995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae5cf8-ffa1-4757-b6ec-f6e3b51269d0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:53.955649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:53.956286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:53.956564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:53.956838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:53.964349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:53.965948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:53.977162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:53.978768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:53.979655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 323/670] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:53.980817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:53.985506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.033873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.036782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca241a-3520-48ab-97a9-3a2913778a57 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.073032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.073674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.073957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.074232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.075138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=1cda9da215144c6ca429f8787be283f8) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:54.075249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.076796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b9b35-fd02-4cea-b2a7-04046ad5c3de None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.087518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0724488-9a91-465d-93e4-8952d7f1f011 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.089282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 348/671] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/role_assignments?user.id=1cda9da215144c6ca429f8787be283f8&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:54.090915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184cd8-e44d-4c6b-9b4a-438aff51fc16 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.091209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184cd8-e44d-4c6b-9b4a-438aff51fc16 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.091489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184cd8-e44d-4c6b-9b4a-438aff51fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.112391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f4184cd8-e44d-4c6b-9b4a-438aff51fc16 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:54.113661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f4184cd8-e44d-4c6b-9b4a-438aff51fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:54.130456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.131402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.131687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.131970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.132638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:54.132947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.134558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.152466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 324/672] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:54.152466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.209168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 349/673] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:54.209168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50df6-7e5d-4ec3-8995-63e2224858ee None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.209168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50df6-7e5d-4ec3-8995-63e2224858ee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.209168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb50df6-7e5d-4ec3-8995-63e2224858ee None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.209168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 350/674] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:54.209168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50df6-7e5d-4ec3-8995-63e2224858ee None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.271910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.273990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742acfd-ec0a-40fa-8392-82309076dbed None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.288917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.317747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.318689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.319193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.319654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.320522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:54.321024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.323324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527d181-45be-473c-93b7-21bd8344b632 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.336110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 325/675] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:54.338395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.338879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.339331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.343755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb50df6-7e5d-4ec3-8995-63e2224858ee None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.358685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:54.360221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:54.378992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.379628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.379912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.380197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.387975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.389471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:54.402037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:54.402964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 351/676] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:54.404248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.465654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 326/677] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:54.466390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.530734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e928b35-3f09-435a-ba66-9b53c8d16243 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.542319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.569183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.570745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.571121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.571541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.573097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=c34d710cbc1e474aa98bf4e2c9cf9374) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:54.573509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.575025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.589531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 352/678] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/role_assignments?user.id=c34d710cbc1e474aa98bf4e2c9cf9374&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:54.590626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.612815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.616770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323f26-2937-4c18-ba57-feb15898b182 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.665713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.666462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.666802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.667137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.668202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:54.668566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.670873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.685410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 327/679] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:54.692725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.799605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfb385-5a92-4d9a-9abb-8e1380f84615 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.845004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.845767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.846128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.846471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.860648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:54.866628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:54.867758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:09:54.868826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:54.869610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 353/680] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:54.870842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.880847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60046-415f-4c3d-ac3f-90814ab28633 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:54.909724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.922821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:54.923428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:54.923701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:54.923971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:54.924693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=016885b1849e4e3d990c3de23c479399) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:54.924994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:54.926450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:54.932895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 328/681] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/role_assignments?user.id=016885b1849e4e3d990c3de23c479399&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:54.933811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:54.961259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:54.989329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8f25-9c31-4e7a-9093-e0941d0b3d73 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.030101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.030864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.031151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.031428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.043644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260815-6022-4d65-82f3-d98d06074518 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.043855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:09:55.049355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:55.050637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:09:55.052078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:55.055392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 354/682] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:55.056761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.082149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.082902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.083249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.083595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.084352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:55.084727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.086231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.096804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 329/683] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:09:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:55.103673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.164987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:55.173364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cde777-42d8-4410-9872-9b4cbd00dea3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.211495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.212243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.212526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.212804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.213498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:55.213800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.215173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.228488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 355/684] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:55.230461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.254188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:55.291853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ae08f-18a5-49a0-a0e2-a0b16fc319ce None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.329288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.329845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.330123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.330396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.342482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.343941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.354804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51a219-0ed0-4d1e-b365-cc18712ef804 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:55.364468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:55.365562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:55.366447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:55.366447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:55.366447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:55.366447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 330/685] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:55.374791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.410058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.410796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.410983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.411309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.423912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.425446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:55.441388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:55.442407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:55.443311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:55.443311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:55.443311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:55.445958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 356/686] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:55.449087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.465492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:55.493304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c983a-1d35-4589-9162-a592d4430339 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.529732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.530438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.530795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.531162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.531882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:55.532359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.533856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.542384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:55.547719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 331/687] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:55.552648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.617939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fe45d-6153-4dfa-8faa-e03ce83ef1c5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.658576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.659191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.659475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.659749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.660463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:55.660771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.662229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.677978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 357/688] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:09:55.684193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.767419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:55.809705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4388-3407-453a-88aa-9666d0914300 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.835736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9e92-dd4d-430f-bccc-5da5cfdf881d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:55.854949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.855834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.856304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.856727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.865547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.867719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:55.881282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:55.882482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:09:55.883648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:55.886834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 358/689] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:55.891934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:55.945848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:55.947138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:55.947456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:55.947732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:55.961320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:55.962803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:09:55.986652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:55.988318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:09:55.989664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:55.997639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 332/690] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:55.998574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:56.017862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27132-9c82-43a6-90cd-d0ffe52fad95 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:56.051222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:56.063379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:56.064319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.064750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.065202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.066269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:56.066746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:56.068629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:56.090632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 359/691] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:56.100257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:56.141678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:56.216405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6869f-807c-4213-bd1b-00976cf165fc None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:56.286634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:56.287249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.287526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.287790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.291160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:56.291475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:56.293212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac13eb7-990a-4cc9-a234-2786f2dcac4b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:56.308810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdb8b6-7ebb-4002-b82a-b304253b5a9c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:56.323871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 333/692] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:09:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:56.327227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fd3f9-f936-439c-a45a-1bf4bff28d96 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.327807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fd3f9-f936-439c-a45a-1bf4bff28d96 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.328182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fd3f9-f936-439c-a45a-1bf4bff28d96 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.329839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 334/693] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:56.330570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fd3f9-f936-439c-a45a-1bf4bff28d96 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:56.367288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff59e51-ae01-4d2e-833d-a78bcaaba357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:56.367900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59e51-ae01-4d2e-833d-a78bcaaba357 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.368178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59e51-ae01-4d2e-833d-a78bcaaba357 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.368510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff59e51-ae01-4d2e-833d-a78bcaaba357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.425766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:56.440768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59e51-ae01-4d2e-833d-a78bcaaba357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:56.442311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff59e51-ae01-4d2e-833d-a78bcaaba357 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:56.450830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fd3f9-f936-439c-a45a-1bf4bff28d96 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:56.469392 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:56.491911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:56.492710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.492996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.493578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.551507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 360/694] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:56.552851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.553155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.553435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.571623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:56.573325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:56.573438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:56.574499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:56.653451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 361/695] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:56.654377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:56.685393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:56.695534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 335/696] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:09:56.707298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:56.739871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:56.837147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442f257-b67e-409e-9d0b-024e32e5b19a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:56.875081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:56.875725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.876001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.876270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:56.897413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:56.898887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:56.903511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e246cf6-d22d-4826-ae75-33619eb7dea2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:56.927480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:56.928699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:56.929991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:56.929991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:56.929991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:56.929991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 362/697] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:56.935252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:56.986502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:56.987080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:56.987408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:56.988321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.004613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.006802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.018575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2a50348a-fc33-45db-91b4-7b1559adaf45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:57.029146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:57.030342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:57.031662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:57.031662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:57.031662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.031662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 336/698] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:57.034517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d71c-1cf6-44c9-bc11-c8b44c2bd99d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.034517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d71c-1cf6-44c9-bc11-c8b44c2bd99d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.034517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975d71c-1cf6-44c9-bc11-c8b44c2bd99d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.035664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 337/699] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:57.036043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975d71c-1cf6-44c9-bc11-c8b44c2bd99d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.059336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418862-f852-455d-8ca7-f1717c8028e4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.096489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51713459-bc27-4573-8e15-80104f544310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.097541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51713459-bc27-4573-8e15-80104f544310 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.098129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51713459-bc27-4573-8e15-80104f544310 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.098474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51713459-bc27-4573-8e15-80104f544310 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.099179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51713459-bc27-4573-8e15-80104f544310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:57.099548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51713459-bc27-4573-8e15-80104f544310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.100979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51713459-bc27-4573-8e15-80104f544310 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.102417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.115707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 363/700] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:57.121347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51713459-bc27-4573-8e15-80104f544310 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.148577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975d71c-1cf6-44c9-bc11-c8b44c2bd99d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.189806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.190743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.191116 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.192207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.192893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.194376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-7b0a2461-d040-49da-b2fb-ff84f29def96 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:57.208810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:57.210022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:09:57.211125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.212810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 338/701] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:57.217396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.217396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.217396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.223546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51713459-bc27-4573-8e15-80104f544310 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.238271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:57.239648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:57.251530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.260346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.261086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.261497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.261893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.262722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:57.263129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.264612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.282069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 364/702] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:57.282069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.319283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 339/703] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:57.320469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.397404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144d830-6100-4934-b9f6-c1f4e95abd46 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.409660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.437134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.437785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.438054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.438333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.445735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.447263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.451962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d9195-0117-4365-9602-455b6124df03 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:57.458559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:57.459434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:57.460318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 365/704] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:57.460789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.492424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.492963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.493327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.493611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.494270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:57.494574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.495942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048bda4-76a4-4738-93d2-70d09d8ff867 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.500336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 340/705] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:57.501509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2904877-0890-4597-91c6-49f0df114851 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.501794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2904877-0890-4597-91c6-49f0df114851 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.502079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2904877-0890-4597-91c6-49f0df114851 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.503465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 341/706] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:57.507927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2904877-0890-4597-91c6-49f0df114851 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.521181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.577212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2768c-9922-484a-bfaa-8ccd4536e606 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.617466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.618103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.618995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.619365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.622649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2904877-0890-4597-91c6-49f0df114851 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.626222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.627691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:09:57.639323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:57.640370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 366/707] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:57.641483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.653219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.663078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.663681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.663958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.664231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.664916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:57.665312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.666916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ab7b6-449c-448a-a335-c9182bad95ec None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.678040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 342/708] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:57.679268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.679557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.679829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.698168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:57.699355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:09:57.748676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f41d-0ee8-4d85-a018-c43fe696d138 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.757345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.766844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 343/709] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:09:57.767678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.782937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.783545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.783826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.784095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.784717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:57.785028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.786413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.792452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 367/710] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:57.793277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.903062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96a5e-bc7f-4db1-9fd4-1628ac3a232b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.922575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:57.943013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164d43-ff0b-4abe-9cc5-da517d3b91e0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:57.949619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.950269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.950551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.950831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.951863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.953644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:57.963636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:57.964661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:09:57.966200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 344/711] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:57.967089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:57.984737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:57.985806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:57.986195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:57.986586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:57.987386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:57.987790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:57.990171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.007358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 368/712] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:58.008238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:58.048225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:58.076773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3d854-ab24-499d-a78b-30949d497fc3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.112728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.113360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.113639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.113907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.114614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=a740dffa48ae44edb8f2a103bd8203c5) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:58.114921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.116336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.123113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 345/713] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:57 2022] GET /identity/v3/role_assignments?user.id=a740dffa48ae44edb8f2a103bd8203c5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:58.123746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:58.129408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae02734-c00b-436d-afe2-76091f455f0b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.173179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.174283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.174684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.175064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.176323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] RBAC: Adding query filter params (name=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:58.177020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.178605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.187841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 369/714] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:09:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:58.189578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:58.197250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:58.272059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4d041-28a8-4a69-ba25-8bb6f2405e88 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.316802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.317690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.318332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.318608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.319082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:58.319811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=ece70bdb48004d8bb17968453f12a6da) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:58.320271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.321899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.327054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7b5f-b80a-448d-aa63-de5a6561e049 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.337604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 346/715] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:09:58 2022] GET /identity/v3/role_assignments?user.id=ece70bdb48004d8bb17968453f12a6da&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:58.337604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:58.381597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.382255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.382540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.382817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.398603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.401216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:09:58.421241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:09:58.422296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:09:58.423201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:09:58.423201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:09:58.423201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:09:58.423201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 370/716] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:09:58.430283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:58.466905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504f519-a5d0-4b99-a97b-c40cd19fa36f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.480291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:09:58.506165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.506803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.507092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.507376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.508025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] RBAC: Adding query filter params (type=network) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:58.508332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.510825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.517617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 347/717] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:09:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:58.606315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc88a6-b62f-4e45-9033-24603fc7836d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.671291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.671938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.672387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.672610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.685394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:09:58.685737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.687172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842facc-78f5-461f-b288-5668d28659ec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.706622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 371/718] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:09:58.713367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:09:58.836564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1500a-d709-44b8-b1e8-92b4c184bf52 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:09:58.886593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe766ba-22f1-4647-b549-843e605cef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:09:58.887136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe766ba-22f1-4647-b549-843e605cef2a None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:58.887420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe766ba-22f1-4647-b549-843e605cef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:58.887699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe766ba-22f1-4647-b549-843e605cef2a None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:58.888355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe766ba-22f1-4647-b549-843e605cef2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:09:58.889831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe766ba-22f1-4647-b549-843e605cef2a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:09:58.921076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 348/719] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:09:58 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:09:59.950270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0ddb-e3a7-496c-b46e-2faa65779991 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:59.951570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0ddb-e3a7-496c-b46e-2faa65779991 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:59.952241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0ddb-e3a7-496c-b46e-2faa65779991 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:59.954113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 372/720] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:09:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:09:59.959143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807069e-dc2a-4f88-bac9-54e4f93e1fa4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:09:59.959944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807069e-dc2a-4f88-bac9-54e4f93e1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:09:59.960448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807069e-dc2a-4f88-bac9-54e4f93e1fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:09:59.990222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9807069e-dc2a-4f88-bac9-54e4f93e1fa4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:09:59.991883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9807069e-dc2a-4f88-bac9-54e4f93e1fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:00.019563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:00.086825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 349/721] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:10:00.361153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6801a-30eb-4888-9cd3-4dd530a2a40d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.361796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6801a-30eb-4888-9cd3-4dd530a2a40d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.362289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e6801a-30eb-4888-9cd3-4dd530a2a40d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.364061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 373/722] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:00.370456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a80a-12cd-42bd-8602-505adf592810 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.370747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a80a-12cd-42bd-8602-505adf592810 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.371024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a80a-12cd-42bd-8602-505adf592810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.393253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-66d9a80a-12cd-42bd-8602-505adf592810 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:00.394441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-66d9a80a-12cd-42bd-8602-505adf592810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:00.485929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 350/723] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:10:00.536893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6801a-30eb-4888-9cd3-4dd530a2a40d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:00.555063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:00.686529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61462-bc52-4391-a850-ebcc29036d04 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.686857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61462-bc52-4391-a850-ebcc29036d04 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.687098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced61462-bc52-4391-a850-ebcc29036d04 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.688605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 351/724] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:00.694047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e6801a-30eb-4888-9cd3-4dd530a2a40d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:00.700713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f1b5e-50f1-4c79-ae17-f94ae13050d3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.700713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f1b5e-50f1-4c79-ae17-f94ae13050d3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.700713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f1b5e-50f1-4c79-ae17-f94ae13050d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.721525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-105f1b5e-50f1-4c79-ae17-f94ae13050d3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:00.723084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-105f1b5e-50f1-4c79-ae17-f94ae13050d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:00.758764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:00.759691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.760054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.760334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.760989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:00.762510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:00.794595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 374/725] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:00 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:00.841627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 352/726] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:10:00.879240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:00.935113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd96dc3-0f37-42ae-babd-d18565b64efc None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.935452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd96dc3-0f37-42ae-babd-d18565b64efc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.935723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd96dc3-0f37-42ae-babd-d18565b64efc None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.937413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 353/727] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:00.943322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:00.943614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:00.944177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:00.968803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:00.970347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:00.977759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:00.987441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:01.022555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f8da4-9b0b-40e3-a7aa-228efb7d5824 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.058949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.059609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.059894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.060173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.065889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 354/728] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:10:01.075715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:01.081378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:01.082371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:01.084239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 375/729] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:01.089397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.154209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.214626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51f09e-2d0a-41aa-82d9-1754104580aa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.252716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.253492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.253817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.254096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.254768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:01.255078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:01.256602 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:01.267403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 355/730] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:01.272959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.285453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:01.379394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4b914-cdd5-479b-af46-214d51c78d15 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.408358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188402e-db89-44ce-ba6c-2b97934ae4e5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.448308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.448973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.449376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.449658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.466962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:01.468508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:01.485366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:01.486372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:01.487274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:01.487274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:01.487274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:01.491708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 356/731] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:01.492766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.545965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:01.558169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.558812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.559369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.559653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.564054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:01.576584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:01.583264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:01.584236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:01.585058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:01.588659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 376/732] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:01.592981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.626111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2080b-d493-4809-99a7-764d2cdcc458 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.664268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.664885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.665791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.666087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.666736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:01.668307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:01.694756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 357/733] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:01 2022] POST /identity/v3/services => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:01.694756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.757366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed79fe9-0a75-4c20-9f00-719de72579ef None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.827663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67545eec-4cdf-41d3-a73b-16709e63c1da None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:01.837968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.839030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.839535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.840098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.840995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:01.841511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:01.843234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:01.843707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:01.861281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 377/734] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:01.867386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.870887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:01.871512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:01.871805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:01.873100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:01.873821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:01.874134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:01.875531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:01.888971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 358/735] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:01.894735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:01.930862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:01.997546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb8e16-a7c4-476b-a648-528aaa7b7544 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.008155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0af234-7148-4539-9f35-0deac02258e8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.041091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.041762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.042037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.042542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.048578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.048872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.049182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.049464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.051132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.052587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.072252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.072252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8e1cdb19-9be7-4367-83b2-ec8abcd713e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:02.072520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:02.073446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 378/736] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4e2-e189-4b06-9550-2506ee93363d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.074356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4e2-e189-4b06-9550-2506ee93363d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.075126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4e2-e189-4b06-9550-2506ee93363d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.076230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 379/737] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:02.078382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.078671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.078928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.097804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:02.098981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:02.099810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:02.100721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:02.101664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:02.101664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:02.101664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:02.106054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 359/738] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:02.106054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.138745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:02.202655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 380/739] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:02.203900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.220848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7cf83-b050-498f-b34c-ab2ca5414d81 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.262506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:02.269813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.270738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.271247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.271732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.272666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:02.273192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.275558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.313088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c5179-ae03-44b1-8543-dda57537a6c6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.324008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 360/740] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:02.329752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.351173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.351788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.352066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.352334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.353688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:02.353997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.358210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.370504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 381/741] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:02.376894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.491087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9e023-b6e7-4ad8-b031-5e789e872fdf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.493443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:02.532267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.533402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:02.534288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.534604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.534881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.546169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.548324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.549635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610cd05-6352-4437-bbe4-fcb667bbf20b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:02.563409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:02.564392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:02.565345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 382/742] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:02.566418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.593803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.594478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.594860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.595141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.686088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.687853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.688724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104a0dc-9065-468d-a574-7b6e79eacfc2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.726326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.727226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.727771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.728384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.739701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:02.746067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:02.747022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:10:02.747980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:02.755214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 383/743] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:02.756308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.778587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:02.800979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:02.825078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 361/744] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:02.826300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.871723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ba851-8f4e-4be7-8f0f-ffa051f7a258 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.918339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c630-803f-4652-8673-a000046d567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.918985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c630-803f-4652-8673-a000046d567a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.919266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c630-803f-4652-8673-a000046d567a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.919523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c630-803f-4652-8673-a000046d567a None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.920921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c630-803f-4652-8673-a000046d567a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:02.921285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c630-803f-4652-8673-a000046d567a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.922749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c630-803f-4652-8673-a000046d567a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:02.946194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 384/745] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:02.947223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c630-803f-4652-8673-a000046d567a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:02.951453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a265f-b435-48d9-85c6-12cdba01bbe1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:02.990328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:02.991187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:02.991467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:02.991801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:02.992647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:02.993059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:02.994776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.004201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 362/746] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:03.005254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.027047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.050671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c630-803f-4652-8673-a000046d567a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.063338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.088167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.088798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.089074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.089410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.099692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.101150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:03.116094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:03.117376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:03.118453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:03.118453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:03.118453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:03.121830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 385/747] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:03.122699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.126088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a5254-997b-47a5-9935-58c9630b8b53 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.163277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.164250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.164697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.165656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.177469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.178915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:03.195244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:03.196514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:03.197952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:03.197952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:03.197952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:03.197952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 363/748] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:03.197952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.231592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bac03-55c1-4119-ad25-62096aa23c2b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.257959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.266458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.267090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.267368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.267636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.278804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.280243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-cbcd2ec0-fe94-4a85-8250-9b93bf2df8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:03.296595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:03.297800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:03.298704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:03.298704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:03.298704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:03.298704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 386/749] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:03.299701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02239-9e8e-4871-a333-081839ce889a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.299982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02239-9e8e-4871-a333-081839ce889a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.300252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02239-9e8e-4871-a333-081839ce889a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.301656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 387/750] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:03.302205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b02239-9e8e-4871-a333-081839ce889a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.309750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.313688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258f5c5-7cfd-4d46-b598-abdea994e6b3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.348468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.349160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.349376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.349647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.350283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:03.350591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.351950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.364051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 364/751] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:03.364854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.416633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b02239-9e8e-4871-a333-081839ce889a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.452410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.453016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.453323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.453595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.454229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:03.454525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.455880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2fa29-28a6-4a2b-9ac3-fa724209e18a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.468287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 388/752] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:03.469636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.469928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.470206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.482101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c657e27-d6b9-4ebf-91d5-1dfc519b1ad8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.488810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:03.490030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:03.519517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.520081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.520438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.520712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.521508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:03.521818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.523199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.527554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.537904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 365/753] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:03.539100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.565428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.568420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 389/754] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:03.569414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.672093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adda40-8626-4a65-a025-1f8e6ac1a93c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.703538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063e50d-3046-43bd-87ce-43be38d9e782 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.715840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.716979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.717483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.718099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.726468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.728568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:03.741284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:03.742191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:03.743063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 366/755] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:03.743590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.747868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.748777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.749290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.749757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.758872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.761555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:03.779380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:03.780272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:03.781268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:03.782374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 390/756] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:03.787150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.821228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.856513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:03.878839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987952-1292-46a6-b6c2-b0f09a5d5f9c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.915491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288abf4b-d047-4a08-aef3-70d847db6104 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:03.915723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.916354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.916638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.916907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.924909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.926383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:03.937603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:03.938603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 367/757] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:03.939561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:03.952402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:03.953010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:03.953325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:03.953597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:03.954292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:03.954600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:03.956021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:03.968516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 391/758] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:03.969345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.038900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb31ae-7d72-40fe-9b1c-9194baff6630 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.058009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.067742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f752a4-9a1f-4727-a30e-61a9bbef17f7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.072883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.073514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.073789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.074084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.074762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:04.075062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.076475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b84516-dc12-48d0-8d72-9d11c5c4794c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.085370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.089495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 368/759] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:04.090904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8742-51ff-4088-93f0-5d871b6f6fd8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.091564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8742-51ff-4088-93f0-5d871b6f6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.092168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8742-51ff-4088-93f0-5d871b6f6fd8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.094048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 369/760] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:04.094758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c8742-51ff-4088-93f0-5d871b6f6fd8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.104297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.104929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.105247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.105526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.106105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.107663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:04.118130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:04.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:04.120516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 392/761] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Aug 29 23:10:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:04.121368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.197346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c8742-51ff-4088-93f0-5d871b6f6fd8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.221978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760b0e0-306e-4093-9db0-6540cfb05f89 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.231727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.232333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.232613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.232888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.233638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:04.233945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.235508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.252792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 370/762] 10.222.0.88 () {56 vars in 1149 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:04.253613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.261455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.262028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.262422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.262734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.263467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=a740dffa48ae44edb8f2a103bd8203c5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:04.263774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.265256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c769fa-6e31-40ca-b69a-b9e024fd37f2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.271059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 393/763] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/role_assignments?user.id=a740dffa48ae44edb8f2a103bd8203c5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:04.272188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.272468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.272738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.307519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:04.308655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:04.324542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.326799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.373523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21052dc8-3402-4dfa-aa5f-8f2bc91bf6f9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.389174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 394/764] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:04.389174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.425880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.426091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.426426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.426624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/ece70bdb48004d8bb17968453f12a6da/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.430035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=ece70bdb48004d8bb17968453f12a6da, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.432007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.453611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 371/765] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:04 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/ece70bdb48004d8bb17968453f12a6da/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:10:04.454723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.566951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d2a24-18af-4d5c-bbbd-4c3706a27b73 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.637621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.638314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.638604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.639639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.639639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:04.639815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.642644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.650639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 395/766] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:04.656067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.658566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c33483-e7ce-482b-935d-e43ec37fa300 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.676413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.684418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.706847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.707465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.707746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.708026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.781395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298c2be-c562-4fad-a3b9-7d25ca2c8292 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.800940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.802591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.819609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.820479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.820909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.821910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.822748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:04.823198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:04.824869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:04.830844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 396/767] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:04.836467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.915379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 372/768] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:04.915379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:04.925569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.931567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:04.956601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28af6-b627-49b7-995b-9171c41fd3a4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:04.996343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:04.997503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:04.997987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:04.998481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] PATH_INFO: `/v3/services/network` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:04.999263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.001034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:05.011542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:05.012552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:10:05.013437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:05.020323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b70bad-ff4b-4017-afdc-35492ebc01fd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.020833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 397/769] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:05.022102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.060271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.060894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.061199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.061476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.062175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] RBAC: Adding query filter params (interface=public, service_id=7338b533ad084b218d591af5e8c7efc9, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:05.062585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.064341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.076973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 373/770] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:04 2022] GET /identity/v3/endpoints?service_id=7338b533ad084b218d591af5e8c7efc9&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:05.076973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.151823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725e08-c89a-49f3-b82f-6ca8a0d4d797 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.177155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:05.193489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.194725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.195211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.195686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.198591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1baba-d14c-49c6-92e8-415c4801a8b8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.206119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:05.209615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.211524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:05.229753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:05.230753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:05.231624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:05.231624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:05.231624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:05.237977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 398/771] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:05.238174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.240355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.240971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.241278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.241552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.242182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] RBAC: Adding query filter params (name=network) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:05.242483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.245142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.249572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 374/772] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:05.250436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.355397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dac67-9017-41a6-9aaf-8dfee4aa5896 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.356243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bfb42-7893-4742-a0b6-af0ae838a129 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.391702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.392316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.392596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.392872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.393551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:05.393859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.395424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.396445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.397503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.398085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.398558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.399422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.401732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.413323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 375/774] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:05.413323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.413636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 399/774] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:05.420875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.428987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:05.542136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:05.582036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a74a-9055-4e34-8541-c6346430a358 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.617483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.618021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.618466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.618766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.619730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:05.620038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.621485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.631792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 376/775] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:05.633188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.647400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6dd7-4405-4ad0-835f-081085739cfb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.697360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.698385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.698896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.699808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.709694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.711415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.725559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:05.729378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:05.730654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:05.731775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:05.737260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 400/776] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:05.738895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.765239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9b59b-7fb5-4242-9fff-c579ea2b04f8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.809931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.811162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.812047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.812525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.813460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] RBAC: Adding query filter params (interface=public, service_id=a50268e1821c49c4a0f6c99caa1ee13f, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:05.813974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.816100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.822560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 377/777] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/endpoints?service_id=a50268e1821c49c4a0f6c99caa1ee13f&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:05.828132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:05.892294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04f24-69f2-47c7-a9bf-92df9deacd7e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.911810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:05.960071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:05.960900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:05.961211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:05.961548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:05.962346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:05.962655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:05.964168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:05.991684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 401/778] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:05.995387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc801c7-b6fb-4abd-aa27-51ae2dbebc7f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:05.999167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:06.038482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4915c1-d695-4380-aba2-97bc18fb7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:06.039374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4915c1-d695-4380-aba2-97bc18fb7bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.039656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4915c1-d695-4380-aba2-97bc18fb7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.039934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4915c1-d695-4380-aba2-97bc18fb7bf8 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.042222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4915c1-d695-4380-aba2-97bc18fb7bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:06.043891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4915c1-d695-4380-aba2-97bc18fb7bf8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:06.053500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:06.055512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 378/779] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:06.176205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760195f9-8ce9-42c0-91b1-b25ea4b67158 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:06.231349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:06.231966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.232250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.232529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.233341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=62c7982ed5014b4a8ff2ff3af660d4e5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:06.233653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:06.235243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d83891-e542-4535-8dce-d6491aa0cc0b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:06.245938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 402/780] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:05 2022] GET /identity/v3/role_assignments?user.id=62c7982ed5014b4a8ff2ff3af660d4e5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:06.382089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53539dc-64c8-4650-a7b9-364aa388b0a3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.382612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53539dc-64c8-4650-a7b9-364aa388b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.382887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53539dc-64c8-4650-a7b9-364aa388b0a3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.385512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 379/781] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:06.391392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ab581-17e6-46a6-ad9b-87c4fb772358 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.391704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ab581-17e6-46a6-ad9b-87c4fb772358 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.391942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ab581-17e6-46a6-ad9b-87c4fb772358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.412877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1e9ab581-17e6-46a6-ad9b-87c4fb772358 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:06.414113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1e9ab581-17e6-46a6-ad9b-87c4fb772358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:06.452257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:06.494045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 403/782] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:06.535011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eed61-6110-454d-bcff-05fdae4aec8f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.535317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eed61-6110-454d-bcff-05fdae4aec8f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.535567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493eed61-6110-454d-bcff-05fdae4aec8f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.537047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 380/783] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:06.542146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.542439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.542775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.569169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:06.570379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:06.667622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 404/784] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:06.774985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eed61-6110-454d-bcff-05fdae4aec8f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:06.910887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493eed61-6110-454d-bcff-05fdae4aec8f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:06.958560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:06.959202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:06.959484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:06.959760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:06.973582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:06.979227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:06.981381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:06.983369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 381/785] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:06.991306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:06.994493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.101494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:07.160042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:07.163754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4979-c38c-4965-8248-66ec397032e5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:07.175484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dc3de-52cc-44bb-bc10-2186d0c05795 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:07.226421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:07.227116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:07.227277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:07.228294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:07.228969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:07.229297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:07.230672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:07.233756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:07.234383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:07.234651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:07.234918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:07.248853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 405/786] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:07.252491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:07.258232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:07.261578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:07.263409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:07.265071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 382/787] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:07.270242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.419776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773dc48-58f7-4f8b-84cc-8a29e7adbdc0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:07.475894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca6193-4f9c-4889-98dc-a037e5fc7a5b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:07.487970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:07.488622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:07.488901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:07.489196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:07.508559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:07.510562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:07.517481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:07.536937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:07.539249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:07.542147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:07.542147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:07.542147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:07.542147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 406/788] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:07.548669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.562996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:07.563620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:07.563898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:07.564167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:07.564838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:07.565155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:07.566542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:07.584591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 383/789] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:07.588923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.589588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:07.733596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd346d99-472b-419c-a905-e0d7d4cb1a5f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:07.751005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025e2d-c81e-4498-acc9-54edb7ca47e5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:07.778892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:07.779538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:07.779819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:07.780097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:07.801512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:07.802978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:07.813064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:07.813717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:07.813994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:07.814269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:07.814911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:07.815214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:07.816585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:07.831980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:07.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:07.833891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:07.833891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:07.833891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:07.840517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 407/790] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:07.840814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 384/791] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:07.841635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.846730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:07.904337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:07.936945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:07.995018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ea8c-0f45-4d28-bf78-074fcd3c3942 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.033217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028a762-31ea-434d-bd62-b804282a3275 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.072588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.073235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.073625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.073909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.074671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:08.074981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.075596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.076371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a8dfe-7dc8-493d-9879-73743f239671 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.076526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.076944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.077382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.087620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.089642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.093144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 408/792] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:08.093144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a57188-7bb0-4f7b-b0a7-19afb6b282b9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.093144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a57188-7bb0-4f7b-b0a7-19afb6b282b9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.093144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a57188-7bb0-4f7b-b0a7-19afb6b282b9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.097687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 409/793] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:08.098942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.099229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.099508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:08.109410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:08.110587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:10:08.111751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:08.114291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 385/794] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:08.119672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.126337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:08.127809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:08.217384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 410/795] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:08.218345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.226809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:08.240045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db8e2-7187-4121-933a-225319b773d2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.279191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.280239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.280722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.281267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.290945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.292798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:08.306641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:08.307606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:08.308563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:08.311062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 386/796] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:08.316784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.371723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:08.455898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5df649-601f-402c-a970-9d1aa6d0fbb5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.481489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668d1a-18b0-413d-9c15-21cad67be98a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.498041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.498651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.498927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.499198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.499923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:08.500221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.501695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4759cd8-04d8-452f-a44b-f5680c4123bd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.520259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.520483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 411/797] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:08.525544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5b819-dc0b-4d25-ac66-ca448128f1a3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.525544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5b819-dc0b-4d25-ac66-ca448128f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.525544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5b819-dc0b-4d25-ac66-ca448128f1a3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.526516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.527010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.527632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.527953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 412/798] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:08.528782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5b819-dc0b-4d25-ac66-ca448128f1a3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.529004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:08.529813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.531476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc3c34-fd97-45df-8ce5-dc752ddbbeb8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.550591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 387/799] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:08.552159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.552646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.553170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.572275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:08.573528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:08.576351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:08.640194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5b819-dc0b-4d25-ac66-ca448128f1a3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.642009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 388/800] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:08.642844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.669671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:08.682618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.683246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.683531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.683797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.694910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.696405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:08.711681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:08.713383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:08.714284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:08.714284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:08.714284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:08.714284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 413/801] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:08.714284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.751455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b055f6-7958-46c1-938f-4214fef3ac23 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.789510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.790241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.790519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.790793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.791371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.792731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3f5d3b53-8267-447f-929a-27aa28177e3b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:08.801729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:08.802725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:08.803550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 389/802] 10.222.0.88 () {56 vars in 1129 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:08.804697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f160c-fe5e-4229-ad44-32e7fe721dc3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.804697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f160c-fe5e-4229-ad44-32e7fe721dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.804697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f160c-fe5e-4229-ad44-32e7fe721dc3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.810090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 390/803] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:08.810870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f160c-fe5e-4229-ad44-32e7fe721dc3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:08.815866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:08.831826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad54106-5b2e-4e37-90cf-ac0dfb2504c7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.869679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a09f-3ea8-4554-905a-68feaa1afad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.870293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a09f-3ea8-4554-905a-68feaa1afad7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.870582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a09f-3ea8-4554-905a-68feaa1afad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.870855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a09f-3ea8-4554-905a-68feaa1afad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.917355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:08.922383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f160c-fe5e-4229-ad44-32e7fe721dc3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:08.944015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a09f-3ea8-4554-905a-68feaa1afad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.945507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a09f-3ea8-4554-905a-68feaa1afad7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.956754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:08.957383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:08.957661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:08.957935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:08.958570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:08.958866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:08.960224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:08.972793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 391/804] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:08.973634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.037836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.046345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 414/805] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:09.047541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.047829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.048102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.065776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:09.066971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:09.076943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fc7eb-b7f5-4b1b-8d93-e919078ce687 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.110414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.111020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.111294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.111561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.112174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:09.112469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.113863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.118259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 392/806] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Aug 29 23:10:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:09.118916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.137100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 415/807] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:09.138192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.142316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.220375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31a377-13af-4a20-bbd6-534d9fe1944a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.244938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ad19-7e67-4470-a86c-5450691d03b0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.248965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.257417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.258056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.258335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.258609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] PATH_INFO: `/v3/services/network` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.259216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.260648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:09.269565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:09.270530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:09.271964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 393/808] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:09.272771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.287666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.288677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.289274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.289723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.297851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.299781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:09.312369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:09.313286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:09.314383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:09.316356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 416/809] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:09.317417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.379536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abf5b8-c661-47b9-a4ec-bb9fa2edff45 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.382868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.414539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.415974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.416254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.416529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.421922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cee1e-f4c8-42ce-a84a-96371f3724b1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.426960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.428429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:09.443571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:09.444563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:09.445487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:09.445487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:09.445487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:09.445487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 394/810] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:09.445487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.461567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.462672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.462949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.463214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.463841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:09.464138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.465530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.470324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 417/811] 10.222.0.88 () {56 vars in 1124 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:09.471075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.494349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.555589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4babd0-a52a-49dc-9dd4-16f7879bc2e6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.569746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51660633-1c4c-48fa-9a11-065c7e8fd7af None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.597794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.604312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.604920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.605226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.605497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.606125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] RBAC: Adding query filter params (name=network) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:09.606420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.607801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.612395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 395/812] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:09.613235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.615822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.616437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.616724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.616998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.618216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:09.618710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.620217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.634563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 418/813] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:09.635440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.737696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ef7a2-c970-44ad-b216-ca22949ea481 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.747006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.757660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e43534-87f5-4265-9aa8-9f4991782db7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.773910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.775171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.775457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.776086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.791494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:09.797547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:09.798528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:10:09.799407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:09.800059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.800059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.800206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 396/814] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:09.800274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.800274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.800405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.800476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:09.800476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.801616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.815773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 419/815] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:09.816607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:09.874590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:09.940227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167831fa-3258-4c6f-a53b-d0bb7ab74dd9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:09.983434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:09.984064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:09.984342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:09.984610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:09.985653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] RBAC: Adding query filter params (type=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:09.985653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:09.987008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:09.992761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 420/816] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:09.993621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.039084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cacf5-38b4-4eec-b613-831a03273fbf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.075191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.075777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.076066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.076335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.076993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.078488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.103502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 397/817] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:10.104426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.120832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85a74c-8e59-49d7-88c9-eac1b61298ab None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.135033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:10.140994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:10.182501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.183290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.183429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.183698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/a740dffa48ae44edb8f2a103bd8203c5/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.185754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=a740dffa48ae44edb8f2a103bd8203c5, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.187272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.205528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 421/818] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:09 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/a740dffa48ae44edb8f2a103bd8203c5/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:10:10.207105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.244901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964b92-fe8c-4408-8304-2adb48c294b3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.300134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.300845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.301200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.301462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.302795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:10.303123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.305067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.317069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 398/819] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:10.318060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.393690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180c06-b4ed-4ccc-85e3-c08e79a56a9a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.439146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.439914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.440197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.440468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.447729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.449213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.453050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:10.460237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5686e-42d3-40c9-9fd9-01f99b15e89e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:10.461199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:10.462731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:10.463691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 422/820] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:10.464173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.498207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:10.503405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.504248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.504632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.505059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.505912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.507434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.533340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 399/821] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:10.534588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.601681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1543b65-6e1e-45b0-9209-0b13cc615cd7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.663141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095f24-a5a9-41d3-a7eb-1fd6ef117f60 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.681953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.682619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.682901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.683176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.699814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.701603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.706027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.707664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.710684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.711338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.714484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:10.714806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.718749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.728762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:10.736533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:10.739044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:10.740139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:10.740139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:10.740139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:10.740354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 400/822] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:10.743516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.743934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 423/823] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:10.749729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.870748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:10.899737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2e42-1a01-4d26-ac80-0176955df3f0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.918995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7237262-8bad-4067-a2b0-0de4e30c44cc None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:10.941189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.941883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.942225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.942503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.943147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:10.943445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.944819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.963046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 424/824] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:10.968756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:10.971226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:10.971849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:10.972132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:10.972449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:10.973162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=ece70bdb48004d8bb17968453f12a6da) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:10.973474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:10.974904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:10.984070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 401/825] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/role_assignments?user.id=ece70bdb48004d8bb17968453f12a6da&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:11.093519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cb093-b63c-4714-abc3-642174d25cf8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:11.132432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:11.133072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:11.133385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:11.133661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:11.141245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:11.142710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:11.145469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:11.157534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:11.158679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:11.159826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:11.162278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 425/826] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:10:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:11.168821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:11.239191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:11.280007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40845c87-15d9-4147-a1ad-2410ec6c75b9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:11.315577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:11.316526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:11.316988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:11.317497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:11.318409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:11.318892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:11.320505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:11.340082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 402/827] 10.222.0.88 () {56 vars in 1149 bytes} [Mon Aug 29 23:10:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:11.346244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:11.457102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98536f34-6689-46c0-9569-8bfa78de1c1d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:11.492460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:11.493013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:11.493552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:11.493921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:11.505011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:11.506594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:11.521791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:11.522747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:11.523627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:11.523627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:11.523627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:11.523627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 426/828] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:11.529589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:11.644972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d4bba-e470-424f-b20e-50429a5bb91c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:11.666923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:11.682706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:11.683374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:11.683655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:11.683922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:11.684554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:11.684855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:11.686284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:11.702827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 403/829] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:11.706175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:11.764849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:11.820006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5819016-98e5-4759-9c14-f40ea5e4ae65 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:11.856083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:11.856721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:11.857000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:11.857301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:11.864307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:11.865793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:11.877981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:11.878909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:11.879805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 427/830] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:11.885750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:11.997903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03649-8b4d-40a1-aa48-263cba51f4af None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:12.035288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:12.036136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.036461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.036731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.037493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:12.037791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:12.039355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ae1f-2a4a-48af-9da3-41cb6f24ee36 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:12.056431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 404/831] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:12.058670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:12.169421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24408410-b679-489d-a822-677a016b6ad9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:12.183114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:12.206355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e63781-77ab-4e28-976a-2b60330a48a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:12.207024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63781-77ab-4e28-976a-2b60330a48a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.207304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63781-77ab-4e28-976a-2b60330a48a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.207578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e63781-77ab-4e28-976a-2b60330a48a1 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/62c7982ed5014b4a8ff2ff3af660d4e5/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.224216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e63781-77ab-4e28-976a-2b60330a48a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=62c7982ed5014b4a8ff2ff3af660d4e5, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:12.225722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e63781-77ab-4e28-976a-2b60330a48a1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:12.241700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 428/832] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:12 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/62c7982ed5014b4a8ff2ff3af660d4e5/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:10:12.257712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636991-049b-4612-9412-01225d4f1191 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.258054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636991-049b-4612-9412-01225d4f1191 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.258230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f636991-049b-4612-9412-01225d4f1191 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.260041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 405/833] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:12.265776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.266082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.266335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.286818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:12.288022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:12.320634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46208a-7572-4a86-b1a2-fbf901ad6b44 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.320949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46208a-7572-4a86-b1a2-fbf901ad6b44 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.321740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46208a-7572-4a86-b1a2-fbf901ad6b44 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.323602 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 406/834] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:12.329324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.330495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.330495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.349537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:12.350804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:12.366690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 429/835] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:12.392903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:12.430125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 407/836] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:12.644581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:12.701974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:12.739800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:12.749314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe26c2-5dc8-41f2-934d-da14b5bf44aa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:12.787569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:12.788213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.788930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.789255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.789849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:12.792345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:12.804158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:12.805433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:12.806848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 430/837] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:12.811446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:12.819243 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f900299-4dfe-4eb9-880c-43271cbc4134 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:12.856342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:12.857176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.857552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.857921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.868733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:12.873933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:12.875045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:12.876069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:12.877916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 408/838] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:12.884172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:12.915361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921f5d-6add-4f12-aec9-67992c065e84 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:12.919666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:12.955252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:12.956411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:12.956951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:12.957545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:12.958533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:12.959051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:12.960738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:12.966969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 431/839] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:12.972261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.007031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:13.017578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f940713-855e-4deb-b0be-84eaa242a0f3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.066232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.067334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.067867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.068368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.069721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:13.070226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.072734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.085417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 409/840] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:13.091132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.104130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8f0d-2fa9-4735-b7aa-0acf9f36f2b7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.141026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.141580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.141854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.142163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.142737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:13.143041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.144427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff45c-9a96-40f4-8e1a-9a473c9ce7a6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.149278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 432/841] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:13.151350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee580-94b6-4180-8199-41309ecd8b22 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.151653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee580-94b6-4180-8199-41309ecd8b22 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.151926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee580-94b6-4180-8199-41309ecd8b22 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.157459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 433/842] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:13.158890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.159171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.159444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.178903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:13.180113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:13.217586 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:13.230415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745cbf5-55d8-4d69-a4ae-0e5403d41cd3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.277139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 434/843] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:13.282969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.283678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.283954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.284225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.296623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.298109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:13.313168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:13.314148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:13.315084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:13.315084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:13.315084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:13.315607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 410/844] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:13.320466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.346291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:13.429273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d76b-f7aa-4f48-885d-9f0a3b7202a4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.468131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.468751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.469034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.469336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.469990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:13.470294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.471681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.484163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 435/845] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:13.490480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.591928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.608678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d47f3-f6c3-461a-aa25-6ecff42a5da2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.660397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.661315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.661601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.661877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.673385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.675366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.683924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:13.697389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:13.698374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 411/846] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:13.704685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.709136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:13.723141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc11f9e-e856-4cce-97fb-cb4f8a24219a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.762561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.763604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.764199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.764670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.765594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.767167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:13.777283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:13.778249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:13.779123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:13.786679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 436/847] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:13.787808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.831100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43bcff-f152-4d20-9853-11428e0b3d59 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.871460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.872424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.872907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.873406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.874339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:13.874873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.876604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.901736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 412/848] 10.222.0.88 () {56 vars in 1135 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:13.902922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.904452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81141c7-1439-48b7-a8ca-3f182918c743 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:13.948006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:13.948550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:13.948840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:13.949139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:13.949791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:13.950467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:13.952200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:13.963500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 437/849] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:13.965886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:13.969581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:13.975185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:14.022803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a04bc-e209-4f91-afe0-24fe66a48aa0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:14.061592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:14.062559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.063058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.063554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.090621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72c265-a496-476f-bfb4-0463d14a89ec None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:14.126502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:14.127261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.127517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.127799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.128442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:14.128765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:14.130166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b513ee-a339-48fb-b1e5-95bfab47565a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:14.141135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 438/850] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:14.145528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:14.147267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:14.223504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:14.265477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ad5-7904-4938-9a42-d6bfb0167897 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.265823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ad5-7904-4938-9a42-d6bfb0167897 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.266039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933ad5-7904-4938-9a42-d6bfb0167897 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.267588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 439/851] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:14.271695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 413/852] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:14.273098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.273422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.273690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.278396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:14.294347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:14.295557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:14.375458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:14.385443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 440/853] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:14.398851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39957067-dced-4679-a273-9aa1f303da1d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:14.434351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:14.435393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.435886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.436361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.447498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:14.449280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:14.464500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:14.465498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:14.466398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:14.466398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:14.466398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:14.468469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 414/854] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:14.477981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:14.583282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08142849-cce0-4a09-8814-79effa17a1bc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:14.627760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:14.628387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.628671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.628944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.637132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:14.637132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:14.637132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:14.644568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 441/855] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:14.649021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:14.656030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:14.668867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:14.736162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:14.783361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ab296-3aef-44cb-aecb-c2bfb82a0a98 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:14.789542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e764-7ce2-4318-a433-1255f48ef736 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:14.819950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:14.820728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.821148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.822146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.833599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:14.835618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:14.836409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:14.836862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:14.837409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:14.839927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:14.841033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:10:14.842111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:14.848648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 415/856] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:14.850068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:14.854935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:14.856684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:14.872996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:14.873986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:14.874894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:14.877663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 442/857] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:14.883361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:14.951927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:14.987573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811146a3-dea1-43e8-9ed0-a1e78e7fffbe None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.014437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfedb7-be47-4992-a42b-7f56223961ae None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.032656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:15.032832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.034133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.034827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.035101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.035773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:15.036117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.037557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.050469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 416/858] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:10:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:15.061140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.061336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.061336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.061336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.061336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.061687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:15.061687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.061687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.073542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 443/859] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:15.080087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.168305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7e6b-9025-425e-b404-5bc6f0cf62c3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.197144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766d714-efec-472c-95ef-51fdb247f10f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.203874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.204502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.204778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.205047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.209234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:15.218120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.219565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.234119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.234760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.235048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-7d3ba1d9-777d-4a50-8d5d-631d9a9f22f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:15.235244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:15.236156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:15.242138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:15.242138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:15.242138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:15.242319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.242319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=a740dffa48ae44edb8f2a103bd8203c5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:15.242319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.242520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 417/860] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:15.242588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69789716-4af4-4bf5-8465-3882089fba8e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.242653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5434bb-225f-4c70-8ea7-73a92c23a204 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.242653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5434bb-225f-4c70-8ea7-73a92c23a204 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.242653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5434bb-225f-4c70-8ea7-73a92c23a204 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.242653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 418/861] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:15.242653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5434bb-225f-4c70-8ea7-73a92c23a204 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.258530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 444/862] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:15 2022] GET /identity/v3/role_assignments?user.id=a740dffa48ae44edb8f2a103bd8203c5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:15.258530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.258530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.258530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.274533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:15.276309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:15.316125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:15.362724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 445/863] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:15.378200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5434bb-225f-4c70-8ea7-73a92c23a204 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.417467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.418143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.418427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.418705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.419497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:15.419804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.421227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.435227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 419/864] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:15.440548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.547717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf3302-7cdc-4949-9bc7-d006ab382933 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.587994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.588632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.588917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.589215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.596874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.598430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:15.611701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:15.612685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:15.613666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 446/865] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:10:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:15.622615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.662078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.677192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:15.698986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:15.742732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19ff6b-75a8-49be-bb72-e822b6c1407c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.785166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f2b3c-08c9-4f1e-b49d-c5502146d1a1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.790092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.791228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.791748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.792217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.793192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:15.794126 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.796298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.823575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 420/866] 10.222.0.88 () {56 vars in 1149 bytes} [Mon Aug 29 23:10:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:15.824054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:15.839105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:15.839722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:15.840002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:15.840279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:15.841575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:15.843274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:15.866432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 447/867] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:15 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:10:15.954324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c95c6-bfb2-406d-b506-3d9d8309c1a0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:15.964181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:16.003943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb30f6-18d8-4828-8d35-d2ec10f09825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:16.004933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb30f6-18d8-4828-8d35-d2ec10f09825 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.005425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb30f6-18d8-4828-8d35-d2ec10f09825 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.005894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb30f6-18d8-4828-8d35-d2ec10f09825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.077277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb30f6-18d8-4828-8d35-d2ec10f09825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:16.079053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb30f6-18d8-4828-8d35-d2ec10f09825 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:16.180644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 421/868] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:15 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:10:16.187209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:16.214091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa2bb6-36c3-4714-8024-059d74a2d467 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.214395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa2bb6-36c3-4714-8024-059d74a2d467 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.214639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa2bb6-36c3-4714-8024-059d74a2d467 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.216258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 422/869] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:16.221179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.221466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.221742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.228719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:16.245984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:16.247742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:16.301939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:16.314766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1471d-0a20-4d6d-a866-8cd57942bcb6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:16.327399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 423/870] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:16.356935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:16.357609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.357939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.358216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.369719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:16.371239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:16.387869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:16.388865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:16.389785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:16.389785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:16.389785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:16.389785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 448/871] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:16.396118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:16.502724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b1a5-44d0-46c4-ba38-e5314c667ded None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:16.534831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:16.541936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:16.542826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.543394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.543902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.544787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:16.545313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:16.546992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:16.559681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 424/872] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:16.565802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:16.609048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:16.694804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0002f-a8e3-4389-8b72-ab91814dad18 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:16.713542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933a048-a7c3-4281-977c-a70cd214793d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:16.738602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:16.739506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.739787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.740207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.748415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:16.749021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:16.749665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.749893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:16.750002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.750223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.750884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:16.752442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:16.763312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:16.764542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:16.765964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 449/873] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:16.771955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:16.777696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:16.778344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 425/874] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:16 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:10:16.897237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d529f-1f15-4d1c-82b9-ef5f365dbe01 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:16.942041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:16.943106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:16.943392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:16.943665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:16.944359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:16.944664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:16.946373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7e7af-a23c-4ade-8b9d-b91913adb6da None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:16.960243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 450/875] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:16.967564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:17.037519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:17.092994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cae57-cf85-4627-bd5d-4a3ca2b9bbaa None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:17.128622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:17.129261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:17.129542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:17.129816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:17.130538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=62c7982ed5014b4a8ff2ff3af660d4e5) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:17.130844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:17.132360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94ad53-34df-48cb-8eea-ea7a7fa22f2a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:17.139381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 426/876] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:16 2022] GET /identity/v3/role_assignments?user.id=62c7982ed5014b4a8ff2ff3af660d4e5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:17.435224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6dbae-3e7a-4215-a767-2586e45f19ce None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:17.435529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6dbae-3e7a-4215-a767-2586e45f19ce None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:17.435811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6dbae-3e7a-4215-a767-2586e45f19ce None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:17.437845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 451/877] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:17.443194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e6ad0-768f-41a3-ad70-7b5291099f50 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:17.443483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e6ad0-768f-41a3-ad70-7b5291099f50 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:17.443769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e6ad0-768f-41a3-ad70-7b5291099f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:17.463624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-661e6ad0-768f-41a3-ad70-7b5291099f50 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:17.464792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-661e6ad0-768f-41a3-ad70-7b5291099f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:17.533383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 427/878] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:17.814569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6dbae-3e7a-4215-a767-2586e45f19ce None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:17.881136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:17.914581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068d37-76a5-4c77-9a60-077eb010c73e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:17.914918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068d37-76a5-4c77-9a60-077eb010c73e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:17.915175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068d37-76a5-4c77-9a60-077eb010c73e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:17.918046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 428/879] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:17.922000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:17.922284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:17.922554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:17.928709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6dbae-3e7a-4215-a767-2586e45f19ce None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:17.940882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:17.942109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:17.969096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:17.969772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:17.970099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:17.970376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:17.971169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:17.972650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:17.982658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:17.983700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:17.984545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 452/880] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:17.991241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:17.999313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:18.027891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 429/881] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:18.106283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fa507-cd8d-430e-9766-faff5b76a41a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:18.129839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:18.143148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:18.143761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.144040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.144311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.144937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:18.145271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:18.146696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:18.152070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 453/882] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:18.157698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:18.263905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e66742-f301-4139-911a-96bc9eff52f5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:18.296706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:18.300755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:18.301408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.301689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.301962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.302589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:18.302887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:18.304247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:18.310306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 430/883] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:18.419010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067a9e-2527-4e56-816a-08a1c63c993a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:18.460632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:18.461304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.461589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.462398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.462987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:18.464365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:18.473653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:18.474679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:18.475736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 454/884] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:18.482937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:18.529620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:18.593559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a81476-7335-4248-9baf-9dfe6c16a7db None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:18.631337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:18.631954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.632232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.632508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.633157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:18.633520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:18.635567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:18.640943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 431/885] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:18.646576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:18.703005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:18.756216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db2892-a385-43e7-b63e-c3a17283113c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:18.793626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:18.794242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.794523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.794797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.795441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:18.795740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:18.797131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e19e-8121-47d4-8774-f6948690cc1d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:18.802617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 455/886] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:18.808710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:18.870447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40004-1844-465f-ab4d-136f049e317f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.870773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40004-1844-465f-ab4d-136f049e317f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.871005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d40004-1844-465f-ab4d-136f049e317f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.872752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 456/887] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:18.879303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b114-d94b-42f5-a3e5-a38860cb6cdd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.879577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b114-d94b-42f5-a3e5-a38860cb6cdd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.879848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b114-d94b-42f5-a3e5-a38860cb6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.900181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a6f0b114-d94b-42f5-a3e5-a38860cb6cdd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:18.901735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a6f0b114-d94b-42f5-a3e5-a38860cb6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:18.923805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec890fd4-465e-4d35-a4f6-b3c039d769b5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:18.932033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:18.964759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:18.965406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:18.965757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:18.966119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:18.966889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] RBAC: Adding query filter params (interface=public, service_id=fcc570ca1d424879bbc4fa27d80e9e02, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:18.967265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:18.968763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:18.974533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 432/888] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:18 2022] GET /identity/v3/endpoints?service_id=fcc570ca1d424879bbc4fa27d80e9e02&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:18.982921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:18.988556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 457/889] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:19.089552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74148aad-68e9-4708-bbd9-b56e7988fb39 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.125019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b064f-d944-4ef0-b4af-046f094f048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.126013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b064f-d944-4ef0-b4af-046f094f048f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.126487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b064f-d944-4ef0-b4af-046f094f048f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.126980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b064f-d944-4ef0-b4af-046f094f048f None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.127825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b064f-d944-4ef0-b4af-046f094f048f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:19.129527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b064f-d944-4ef0-b4af-046f094f048f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:19.141234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 433/890] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:18 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:10:19.264205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08016806-ac84-47a4-af7d-39a11c4adf6b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.264844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08016806-ac84-47a4-af7d-39a11c4adf6b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.265388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08016806-ac84-47a4-af7d-39a11c4adf6b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.267260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 458/891] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:19.272546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.272768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.272996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.293170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08016806-ac84-47a4-af7d-39a11c4adf6b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:19.295460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:19.296795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:19.325811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:19.348117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:19.383527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 434/892] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:19.408263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08016806-ac84-47a4-af7d-39a11c4adf6b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.446609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.447330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.447604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.447880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.448474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:19.449970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:19.459028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:19.459945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:19.461392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 459/893] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:19.466801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:19.569912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf5399-6c9f-4b05-8717-a7e01015e161 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.612634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.613651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.614129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.614597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.615414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:19.615925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:19.623286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:19.633266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 435/894] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:19.635654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:19.661985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:19.695841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:19.762355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2041a56-e416-4177-ba52-96890d018317 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.772087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4565fc-1a2e-4d87-8d20-bc903d991430 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.773845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:19.813258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.813499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.814071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.814353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.814630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.815064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.815266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:19.815570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:19.815928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.816386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.816945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:19.828371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 460/895] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:19.829839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:19.830275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:19.834817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:19.835775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:19.836606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:19.841160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 436/896] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:19.842149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:19.934545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:19.940384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27023ab8-1b1e-46ec-83a7-b6783627be61 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.951688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c0fe-fb2e-4863-850a-7b06d57d32e9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:19.976675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.978384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.978892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.979372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.980280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] RBAC: Adding query filter params (interface=public, service_id=77a2d41e855544daa4c8bfeb20106c22, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:19.980796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:19.982422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:19.989006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:19.989644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:19.989922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:19.990194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:19.990856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:19.991154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:19.992278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 461/897] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/endpoints?service_id=77a2d41e855544daa4c8bfeb20106c22&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:19.992711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:19.997757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.006291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 437/898] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:20.007201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.041533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:20.104612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d59e-6df1-495d-ba58-e824af61e440 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.113950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa57b-8fa1-4d6b-a799-90a87a3c904c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.141869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.142820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.143310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.143788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.144614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.146246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:20.151238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.151880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.152161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.152437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.154012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 462/899] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:19 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:10:20.164552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.166618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:20.176596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:20.186638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:20.187670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:20.188585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:20.188585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:20.188585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:20.188585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 438/900] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:20.194103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.306884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:20.312014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2eb1f-b557-4037-a246-db8e78be39d1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.355598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.356132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.356412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.356686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.357364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:20.357667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.359043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9a621-75e8-476a-8406-ba33b306c840 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:20.371333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 463/901] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:20.377039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.386739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083c28-655a-49a4-b4c1-ac5146f135dc None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.387048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083c28-655a-49a4-b4c1-ac5146f135dc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.387308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083c28-655a-49a4-b4c1-ac5146f135dc None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.388897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 464/902] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:20.394118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.394406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.394688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.413688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:20.415471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:20.485292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36190e8b-6f42-4a71-994c-8d4c9e47ed9e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.486128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 465/903] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:20.520958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.521620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.521898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.522167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.530474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.531927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:20.543833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:20.544756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:20.545708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 439/904] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:10:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:20.550956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.649881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:20.661322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a75cfc-eb97-485b-bc4e-f89a810b3ff9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.701757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.702717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.703194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.703685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.704611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:20.705135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.706758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:20.727363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 466/905] 10.222.0.88 () {56 vars in 1149 bytes} [Mon Aug 29 23:10:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:20.732906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.779591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:20.799199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:20.844964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12c3d0-37d1-41f3-acbd-15532316f709 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.882856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9776dc-30e5-4964-866b-f69a7e2ce50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.883774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9776dc-30e5-4964-866b-f69a7e2ce50b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.884245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9776dc-30e5-4964-866b-f69a7e2ce50b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.884728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9776dc-30e5-4964-866b-f69a7e2ce50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.885143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ca2e5-ee05-4cbe-9d5c-3d88060f9bb3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:20.924469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:20.924723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:20.925056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:20.925431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:20.926174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.927630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:20.953610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 467/906] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:20 2022] POST /identity/v3/services => generated 241 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:10:20.967266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9776dc-30e5-4964-866b-f69a7e2ce50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:20.969004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9776dc-30e5-4964-866b-f69a7e2ce50b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.038339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:21.088252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 440/907] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:20 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:21.094391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.109976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:21.169034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22887fec-7239-4cf3-a0f7-8c905ca32a4e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.169629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22887fec-7239-4cf3-a0f7-8c905ca32a4e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.169629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22887fec-7239-4cf3-a0f7-8c905ca32a4e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.170941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 441/908] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:21.176141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.176420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.176696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.195672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:21.196920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:21.225102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd4b2f-755c-476a-be9d-cf2209342e84 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:21.261701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:21.262338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.262615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.262892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.274113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:21.275861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.284274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 442/909] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:21.293020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:21.294004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:21.294997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:21.294997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:21.294997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:21.294997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 468/910] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:21.299906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.396922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:21.407824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9639dbc-39bd-4de6-8d9b-c3e67c698ea9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:21.447138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:21.448104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.448586 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.449054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.449916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:21.450470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:21.452058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.464911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 443/911] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:21.470785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.530273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:21.559383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.580571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2cca-a381-401a-937d-d5f50fea002c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:21.632354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:21.633027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.633350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.633728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.643762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:21.645538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:21.661341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:21.662304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:21.663797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 469/912] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:21.668587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.696428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9792-58a5-4aee-b7c3-1fd8c5fb7eda None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:21.733827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:21.734399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.734812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.735287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.736284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:21.738059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:21.750318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:21.756866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:21.757855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 444/913] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:21.759979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.781208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:21.803588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa240af-cbf1-4117-885f-2729b3f59e7e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:21.823551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:21.847413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:21.848104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.848391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.848664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.849389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:21.849695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:21.852106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.868037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 470/914] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:21.874473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.895975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efc35b-de13-4e19-8f92-c6073ca490b4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:21.941439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:21.942975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:21.943465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:21.943945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:21.944771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:21.945450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:21.947856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:21.954161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 445/915] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:21.960058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:21.989287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c630-2249-48c9-bd7b-51b4fd45c1a9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:22.029010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:22.029937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.029937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.030214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.030946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] RBAC: Adding query filter params (role.id=3128aa2c8b4a4baa96cb93a40a93c68e, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=62c7982ed5014b4a8ff2ff3af660d4e5) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:22.031256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:22.032703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:22.045453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 471/916] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/role_assignments?user.id=62c7982ed5014b4a8ff2ff3af660d4e5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=3128aa2c8b4a4baa96cb93a40a93c68e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:22.062029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:22.088618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ab52-0057-41ad-8e5f-333d5544c230 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:22.128160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:22.129221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.129713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.130202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.131039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:22.131545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:22.133221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eb9f2-6bf9-4c70-b758-3e311d0121ac None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:22.140394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 446/917] 10.222.0.88 () {56 vars in 1114 bytes} [Mon Aug 29 23:10:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:22.148700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:22.196955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:22.231604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027dcd-e668-42ae-9c17-c8a8b4383cdb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.232155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027dcd-e668-42ae-9c17-c8a8b4383cdb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.232155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be027dcd-e668-42ae-9c17-c8a8b4383cdb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.234063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 447/918] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:22.239410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.239642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.239923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.258972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661c9d-93ec-4aa6-a109-dab5645a8203 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:22.259472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:22.260772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:22.298432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:22.299043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.299324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.299598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.300263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:22.301674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:22.329199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 472/919] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:22.357956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 448/920] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:22.639608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:22.741342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:22.750117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d29050-1d3c-44e2-aebd-b62bcb70a49e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:22.785739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:22.786739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.787240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.787714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.788495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:22.790707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:22.800027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:22.800972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:10:22.801894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:22.804571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 473/921] 10.222.0.88 () {56 vars in 1132 bytes} [Mon Aug 29 23:10:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:22.810495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:22.886229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:22.922450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be287a5b-1d85-464c-b6b1-6bc061d8ed68 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:22.958496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:22.959297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:22.959679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:22.960054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:22.960789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:22.961234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:22.963371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa5e07-eed9-4955-b21d-5290c5e86a6e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:22.968777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 449/922] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:22.974692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:23.033142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303563-08cd-4d8c-8767-c70e98684994 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.033436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303563-08cd-4d8c-8767-c70e98684994 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.033714 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b303563-08cd-4d8c-8767-c70e98684994 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.036269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 450/923] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:23.041056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.041481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.041765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.064396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:23.066159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:23.094004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a33c19-d9d3-4a81-a1cb-b4086fbac476 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:23.138883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:23.139843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.140198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.140542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.141293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:23.141736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:23.143713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:23.151817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 474/924] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:23.155081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 451/925] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:23.157349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:23.189148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:23.269796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990892-f4f0-490d-b433-bd3d7eeb8cf4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:23.305324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:23.306758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.307044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.307322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.308003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:23.309401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:23.332547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 475/926] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:10:23.447095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:23.516310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:23.558501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772c085-3b33-4a62-aaf6-fce73a5751e1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:23.599342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:23.599976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.600252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.600518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.601092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:23.603147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:23.612316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:23.613379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:23.614233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 452/927] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:23.620404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:23.707007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:23.729221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67753f47-97d2-445f-94f5-8306aac09d1a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:23.766054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:23.766698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.766959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.767234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.767865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:23.768165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:23.769574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:23.775769 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 476/928] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:23.781452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:23.889409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032f9ed-b91f-43f7-82ab-f8fec17ba1e4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:23.913502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:23.926023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:23.926635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:23.926916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:23.927190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:23.927818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:23.928119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:23.929519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:23.935845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 453/929] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:23.941554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:24.048363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc663-de48-4a78-a2c7-ee9ee58ead76 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:24.084137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:24.084754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.085033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.085335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.086036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] RBAC: Adding query filter params (interface=public, service_id=c80349eadbca48d48bf04a1c2201102f, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:24.086347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:24.088167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aed2ef-b5fd-4e49-97ca-95cbb7486865 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:24.093805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 477/930] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:23 2022] GET /identity/v3/endpoints?service_id=c80349eadbca48d48bf04a1c2201102f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:24.102192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:24.137452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacdc81-b342-49ff-aa0a-e633ba72407d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.137804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacdc81-b342-49ff-aa0a-e633ba72407d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.138030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacdc81-b342-49ff-aa0a-e633ba72407d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.139646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 478/931] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:24.146301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef820d2-dc0f-413f-b838-be3416eb120d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.146705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef820d2-dc0f-413f-b838-be3416eb120d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.147117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef820d2-dc0f-413f-b838-be3416eb120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.168199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cef820d2-dc0f-413f-b838-be3416eb120d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:24.169826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cef820d2-dc0f-413f-b838-be3416eb120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:24.173377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:24.222080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918983f-8e9f-42ac-9555-42efc3e6a7a0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:24.253342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 479/932] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:24.264090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a51038-e701-4f43-8ac0-4928c5160a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:24.264708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51038-e701-4f43-8ac0-4928c5160a22 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.264989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51038-e701-4f43-8ac0-4928c5160a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.265305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a51038-e701-4f43-8ac0-4928c5160a22 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.265918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a51038-e701-4f43-8ac0-4928c5160a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:24.267285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a51038-e701-4f43-8ac0-4928c5160a22 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:24.273766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 454/933] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:24 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:10:24.318552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35eff84-09ad-4bc3-bd9b-2edc9bc90a9d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.318744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35eff84-09ad-4bc3-bd9b-2edc9bc90a9d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.319023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35eff84-09ad-4bc3-bd9b-2edc9bc90a9d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.320606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 480/934] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:24.327109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.327753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.328220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.349017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:24.350277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:24.404398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:24.428095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 455/935] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:24.532886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35eff84-09ad-4bc3-bd9b-2edc9bc90a9d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:24.638815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35eff84-09ad-4bc3-bd9b-2edc9bc90a9d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:24.673930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:24.674564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.674845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.675121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.682786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:24.686516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:24.691418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:24.692359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:24.693265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.697215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 481/936] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Aug 29 23:10:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:24.699458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:24.708540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:24.817222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d14846-fe5b-446c-b05c-24cd6a01d108 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:24.835404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0507c-de9a-4d86-b653-f676330e17b9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:24.852994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:24.853663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.853946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.854215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.854879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:24.855176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:24.856538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:24.864928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 456/937] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:10:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:24.871141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:24.887709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:24.888640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:24.889309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:24.889780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:24.890797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:24.892503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:24.895470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING keystone.server.flask.common [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 23:10:24.915899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.sql.core [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:10:24.915899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 23:10:24.915899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [parameters: {'id': '4daa67e9bd15424f9771062805402971', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 23:10:24.915899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:10:24.919573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4daa67e9bd15424f9771062805402971.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4daa67e9bd15424f9771062805402971. Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:10:24.925908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 23:10:24.926758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application yield resource Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise self.value Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application session.commit() Aug 29 23:10:24.927701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:10:24.928577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:10:24.929525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:10:24.930381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [parameters: {'id': '4daa67e9bd15424f9771062805402971', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:24.931818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:24.932618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4daa67e9bd15424f9771062805402971. Aug 29 23:10:24.935332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:24.937919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 482/938] 10.222.0.88 () {60 vars in 1140 bytes} [Mon Aug 29 23:10:24 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:24.945500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.001538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fbe97-9060-4768-b588-5c66b9bd0d3f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.021245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:25.050594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.051592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.052091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.052597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.064251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.066012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.080188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f9156-47c9-4fad-9160-8b87f1ce0989 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:25.082139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:25.083089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:25.083984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:25.083984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:25.083984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:25.089473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 457/939] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:25.092872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.127941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.128592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.128868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.129170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.138594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.140654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:25.155901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:25.156838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:25.157772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:25.159920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 483/940] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:25.165819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.207832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:25.216213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9d2a4-0cf6-4237-99ea-c115eebd0b09 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.253637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.254036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.254319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.254592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.255248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:25.255645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.256942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.276684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 458/941] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:25.282052 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.305433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112b1a-bdeb-4974-9c7a-2be55d5f24b5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.322465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:25.346137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.346738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.347013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.347308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.347976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:25.348271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.349751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefc3ae-1552-4b8a-b527-e0489aeb0156 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.378232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 484/942] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:25.378232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b3815-f3d2-444f-b5f5-e2fe2a348a47 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.378232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b3815-f3d2-444f-b5f5-e2fe2a348a47 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.378232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b3815-f3d2-444f-b5f5-e2fe2a348a47 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.378232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 485/943] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:25.385681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.385681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.385681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.403699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:25.405699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:25.412510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513d449-34a7-46e4-9bd8-ad7ac25988e8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.456498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.457169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.457452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.457723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.472018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.474388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:25.492733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:25.495168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:25.496529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 459/944] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:25.497325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 486/945] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:25.502551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.528702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:25.616034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11ec8-e3c7-4939-9a5c-a76350cb0ad5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.652264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.652877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.653182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.653466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.654242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:25.654497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.655925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.674721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 460/946] 10.222.0.88 () {56 vars in 1149 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:25.682559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.791344 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3cc9f-105e-43a0-8120-42d5042562e1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.792451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.793960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:25.837475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.838122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.838405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.838679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.853304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.854773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.875005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:25.876697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:25.877935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:25.879089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:25.879089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:25.879089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:25.879089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 487/947] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:25.884338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:25.917137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255a98b-01d9-4035-867b-a9c100dfbeb1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:25.957509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:25.958466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:25.958754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:25.959028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:25.959617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:25.960996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:25.970805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:25.971826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:25.972697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 461/948] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:25.978313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.006177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ffbed-a27c-4357-ba1b-0d3919ea37da None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.043307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.044025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.044315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.044590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.045279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:26.045588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.047055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.060208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 488/949] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:26.065639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.083310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52d5bc-5acd-43fe-a3e8-290d1533ce0b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.117508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.119323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.119941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.120229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.120498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.121155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:26.121470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.122960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.125014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.133351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 462/950] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:26.134442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.179397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5740-b063-41b3-875a-aabfa1875514 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.216682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.217612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.218033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.218446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.226285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.228457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.239333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a826c33-bf3c-461d-912b-07bc859ac6e7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:26.242424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:26.243514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:26.244404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:26.246401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 489/951] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:26.253250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.276084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.277078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.277460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.277813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.278510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:26.278886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.280331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7015b-0860-4cd9-a949-c69ae25d75fb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.293417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 463/952] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:26.310080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691bbb5-d9b4-42c5-b0a0-9636dad1c8ca None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.310399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691bbb5-d9b4-42c5-b0a0-9636dad1c8ca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.310630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691bbb5-d9b4-42c5-b0a0-9636dad1c8ca None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.313636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 464/953] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:26.318266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.318548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.318829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.340499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:26.341778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:26.364272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.406292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dd59c-0646-4404-a96e-d71c2824300e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.417194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.430254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 465/954] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:26.450382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.451284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.451776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.452230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.453103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:26.453620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.455218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.468933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 490/955] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:26.474492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.580528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4c5a8-ec4c-4651-b232-57546204c88d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.620474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.621172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.621459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.621748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/62c7982ed5014b4a8ff2ff3af660d4e5/roles/3128aa2c8b4a4baa96cb93a40a93c68e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.624063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=62c7982ed5014b4a8ff2ff3af660d4e5, role_id=3128aa2c8b4a4baa96cb93a40a93c68e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.625536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.641482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 466/956] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:26 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/62c7982ed5014b4a8ff2ff3af660d4e5/roles/3128aa2c8b4a4baa96cb93a40a93c68e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:10:26.701871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.820194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8457d-3eab-46fc-b950-06c56ddced63 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:26.860928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:26.861591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:26.861876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:26.862145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:26.862731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:26.864093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:26.867139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:26.874466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:26.875599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:26.876502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:26.880564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 491/957] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:26.881968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:26.940434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:26.991919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643688a5-83f1-41f0-a67d-d883527e1b84 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:27.030027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:27.030699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:27.030985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:27.031262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:27.031895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:27.032253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:27.033658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:27.039046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 467/958] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:27.044556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:27.157382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53269d8-2910-4132-9f40-fe4a9cc7b444 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:27.193661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:27.194272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:27.194557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:27.194833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:27.195466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:27.195770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:27.198137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d9ac2-921b-416f-860e-898d86cb4085 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:27.203699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 492/959] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:27.210215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:27.321640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cc92c-bcb9-47ed-acc7-3ddf8287c441 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:27.341388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:27.360545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f215cd1-9a0f-4741-bf07-d1039b5027c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:27.361172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215cd1-9a0f-4741-bf07-d1039b5027c5 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:27.361449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215cd1-9a0f-4741-bf07-d1039b5027c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:27.361718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f215cd1-9a0f-4741-bf07-d1039b5027c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:27.362374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215cd1-9a0f-4741-bf07-d1039b5027c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:27.363725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f215cd1-9a0f-4741-bf07-d1039b5027c5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:27.385964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 468/960] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:27.563551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0fb94-cb1a-4ff7-847d-1b7de5270831 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:27.564087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0fb94-cb1a-4ff7-847d-1b7de5270831 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:27.564087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0fb94-cb1a-4ff7-847d-1b7de5270831 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:27.565633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 493/961] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:27.571153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:27.571426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:27.571753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:27.591201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:27.592378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:27.671416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 469/962] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:27.940480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0fb94-cb1a-4ff7-847d-1b7de5270831 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:28.007070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:28.050295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0fb94-cb1a-4ff7-847d-1b7de5270831 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:28.086490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:28.087602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.088115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.088592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.089481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:28.091152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:28.107961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.sql.core [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:10:28.107961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 23:10:28.107961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [parameters: {'user_id': '05869a963fd14afc9a48a48401571fbe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 23:10:28.107961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Aug 29 23:10:28.115203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:10:28.116080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application yield resource Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise self.value Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application session.commit() Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:10:28.117079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:10:28.118156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:10:28.119220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:10:28.120082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [parameters: {'user_id': '05869a963fd14afc9a48a48401571fbe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:28.121037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 23:10:28.124022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 23:10:28.126317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 23:10:28.126317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 23:10:28.126317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:10:28.126317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:10:28.126317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 23:10:28.126317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:28.128781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 494/963] 10.222.0.88 () {60 vars in 1131 bytes} [Mon Aug 29 23:10:27 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:28.135277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:28.237000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:28.240552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577ca7-b3e3-47d1-84a1-bee8192c1a61 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:28.282910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:28.283645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.283932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.284204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.292468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:28.294110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-079c60e7-3cde-4f4d-92ba-dbe7fd5f20be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:28.306192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:28.308450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:28.310912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 470/964] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:28.317135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:28.429538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45911-8049-451e-9356-70f2047a9b1e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:28.442849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a293c-74b2-44b5-8f88-86268871e804 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.443130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a293c-74b2-44b5-8f88-86268871e804 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.443406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a293c-74b2-44b5-8f88-86268871e804 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.444986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 471/965] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:28.453179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a27272-5b69-4dd3-b81c-ee239d9cbb54 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.453465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a27272-5b69-4dd3-b81c-ee239d9cbb54 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.453746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a27272-5b69-4dd3-b81c-ee239d9cbb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.462286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:28.473055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:28.473907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.474361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.474784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.475701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:28.476151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:28.478301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6b55b-7a8c-4dd5-9e95-6c20fa8b1b42 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:28.479021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-14a27272-5b69-4dd3-b81c-ee239d9cbb54 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:28.480310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-14a27272-5b69-4dd3-b81c-ee239d9cbb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:28.521282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 495/966] 10.222.0.88 () {56 vars in 1101 bytes} [Mon Aug 29 23:10:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:28.558426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 472/967] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:28.695532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51f95-3ce4-4069-9ecc-27866f6331fb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.697018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51f95-3ce4-4069-9ecc-27866f6331fb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.697530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51f95-3ce4-4069-9ecc-27866f6331fb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.699336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 496/968] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:28.704775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.705047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.705346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.724040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:28.725616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:28.798751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 473/969] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:28.837562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51f95-3ce4-4069-9ecc-27866f6331fb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:28.943533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51f95-3ce4-4069-9ecc-27866f6331fb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:28.989874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:28.990480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:28.990764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:28.991089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:28.991767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:28.993735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:29.009334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 497/970] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:28 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:29.069312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.093484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:29.177725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bb6c8-bf8d-451c-b794-796635981059 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:29.221489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582ede-da31-4318-b5b4-7eeba9ae5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:29.222133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582ede-da31-4318-b5b4-7eeba9ae5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.222412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582ede-da31-4318-b5b4-7eeba9ae5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.222686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582ede-da31-4318-b5b4-7eeba9ae5dd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.233092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582ede-da31-4318-b5b4-7eeba9ae5dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6a582ede-da31-4318-b5b4-7eeba9ae5dd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:29.238051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:29.238971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:29.239807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 474/971] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:29.245694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.295292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:29.354121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c987fb-5df6-4dbe-8286-5de6118c8958 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:29.371505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde03-8414-4ab3-83e6-649b8851fa99 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.371792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde03-8414-4ab3-83e6-649b8851fa99 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.373467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde03-8414-4ab3-83e6-649b8851fa99 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.374982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 475/972] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:29.379970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.380258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.380545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.388858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:29.389742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.390028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.390307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.390980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:29.391290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:29.392663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:29.399312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:29.400629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:29.405870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 498/973] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:29.406801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.474044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 476/974] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:29.510230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d28c11-c1a0-4d6c-83d0-d3788ee9e180 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:29.517430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:29.546199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:29.546832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.547122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.547399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.557820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:29.559265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:29.574231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:29.575172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:29.580748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:29.580748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:29.580748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:29.580748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 499/975] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:29.581337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.590506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:29.688160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfac9b2-915b-431c-834e-f2b4da157364 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:29.722410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:29.722997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.723271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.723539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.724167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:29.724464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:29.725852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:29.737161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 477/976] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:29.742601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.762284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.832402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:29.859289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625797d-ec40-430b-8b44-f671e64b1090 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:29.868806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5731fe0-7ae1-4a20-a668-9375ceb25b3f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:29.896764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:29.897346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.897636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.897911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.904209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:29.904836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:29.905131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:29.905409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:29.905985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:29.906562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:29.907370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:29.908238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:29.916255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:29.917281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:29.918150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 478/977] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:29.922342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:29.923470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:10:29.924701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:29.925544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 500/978] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:29.926518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.928972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:29.956875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.043281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202dacc-20ab-4256-aa58-ea1f3e85b635 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.051987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54254-2094-4d23-a71e-7a3a050ed553 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.079561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.080175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.080458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.080731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.081491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:30.081797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.083226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.085309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.092286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.092896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.093207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.094227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.094227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:30.094427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.095725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.105896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 479/979] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:30.107506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 501/980] 10.222.0.88 () {56 vars in 1149 bytes} [Mon Aug 29 23:10:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:30.108139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.108476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.189740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.214613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa5f42-d04a-459a-a7dc-c0500c70b595 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.221875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce85a-b0bc-44e2-8a96-00501e1da778 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.255387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.255997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.256318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.256550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.257409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.258015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.258292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.258607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.259323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:30.259636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.261162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.266318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 480/981] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:30.272188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.332395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.333895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.335595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.383123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29f36-f612-4d35-be17-d44ffd7b1abf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.417394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.422378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.422996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.423278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.423554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.424258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] RBAC: Adding query filter params (interface=admin, service_id=c80349eadbca48d48bf04a1c2201102f, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:30.424569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.425969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.436726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 481/982] 10.222.0.88 () {56 vars in 1249 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/endpoints?service_id=c80349eadbca48d48bf04a1c2201102f&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:30.437631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.445300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 502/983] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:30.451186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.549007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8af3-76a2-482e-84bb-0aff995f56d6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.554743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99dada-4ae2-46ae-88b2-3f856929f8cc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.574996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.588407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.589031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.589341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.589640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.590227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.591661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.595585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.596221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.596505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.596778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.598313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 482/984] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:10:30.608248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.609901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:30.628319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:30.629689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:30.630609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:30.630609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:30.630609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:30.630609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 503/985] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:30.636188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.747646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a55096-13fa-46b1-a755-331a92507475 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.783698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.784310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.784591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.784868 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.785547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:30.785862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.787228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628ba712-e0fb-4caa-90fc-162c89e00730 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.801147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 483/986] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:30.806438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.836325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:30.912123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c490f5-eed4-4fea-8144-44f4fe900a73 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:30.946472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2272f-e346-4cef-bee1-3d6d35a37f64 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.946733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2272f-e346-4cef-bee1-3d6d35a37f64 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.947047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2272f-e346-4cef-bee1-3d6d35a37f64 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.947317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:30.947962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.948240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.949152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.949298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 484/987] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:30.953530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:30.954028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:30.954477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:30.957614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:30.959052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:30.971632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:30.972618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:30.973962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 504/988] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:30.978086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:30.978367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:30.979603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:31.026848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:31.053137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 485/989] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:31.075205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:31.088878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979538b-617d-46fe-94ad-4599ecfe55f6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:31.122185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:31.123057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:31.123481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:31.123903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:31.124731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:31.125209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:31.126922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:31.140011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 505/990] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:31.146033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:31.243684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a92739-54fc-42d4-86ad-49f5b5375775 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:31.278087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:31.278607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:31.278880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:31.279151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:31.279862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] RBAC: Adding query filter params (role.id=3128aa2c8b4a4baa96cb93a40a93c68e, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=62c7982ed5014b4a8ff2ff3af660d4e5) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:31.280163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:31.281607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:31.287230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 486/991] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:31 2022] GET /identity/v3/role_assignments?user.id=62c7982ed5014b4a8ff2ff3af660d4e5&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=3128aa2c8b4a4baa96cb93a40a93c68e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:31.324488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:31.435673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b2132-1637-46f0-8c57-00b1597c4568 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:31.480136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:31.480770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:31.481056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:31.481358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:31.481940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:31.483303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:31.492241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:31.494146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:31.495142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:31.498959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 506/992] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:31.500300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:31.544535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:31.610177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef717064-9e97-4e8c-9fa0-3fe1f2fbe202 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:31.646900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:31.647513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:31.647790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:31.648060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:31.648680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:31.648978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:31.651488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:31.660983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 487/993] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:31.662588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:31.678782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:31.768556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fd7b3-f19f-4c6c-bd13-b415d3b57b27 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:31.803719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:31.804243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:31.804519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:31.804789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:31.805503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:31.805799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:31.807157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:31.812213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 507/994] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:31.817945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:31.918410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ed764-9433-4291-af75-f2c04a9132ae None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:31.920711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:31.953554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:31.954161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:31.954434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:31.954698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:31.955380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] RBAC: Adding query filter params (interface=public, service_id=642b04140cc44ac39326af0a8fc33e91, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:31.955679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:31.957026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664e7d3-e2ef-451b-ad71-e835398765bb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:31.967571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 488/995] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:31 2022] GET /identity/v3/endpoints?service_id=642b04140cc44ac39326af0a8fc33e91&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:31.968863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:32.047013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:32.073042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3287fe-beea-4f53-bafc-dd743cd3e5cd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:32.105902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ef75a-649d-4695-a3b6-e68cba2c3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:32.106501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef75a-649d-4695-a3b6-e68cba2c3dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:32.106780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef75a-649d-4695-a3b6-e68cba2c3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:32.107052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef75a-649d-4695-a3b6-e68cba2c3dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:32.107648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ef75a-649d-4695-a3b6-e68cba2c3dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:32.109006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ef75a-649d-4695-a3b6-e68cba2c3dd6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:32.115282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 508/996] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:31 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:10:32.547676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5577e36-a4cc-4e6c-bf1d-c7b401723424 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:32.548182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5577e36-a4cc-4e6c-bf1d-c7b401723424 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:32.548284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5577e36-a4cc-4e6c-bf1d-c7b401723424 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:32.549633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 489/997] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:32.554678 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:32.554974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:32.555274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:32.574393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:32.575919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:32.647991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 509/998] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:32.917522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5577e36-a4cc-4e6c-bf1d-c7b401723424 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:33.022886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5577e36-a4cc-4e6c-bf1d-c7b401723424 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:33.056868 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:33.057861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.058339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.058825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.059592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:33.061190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:33.070401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:33.071995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:10:33.072846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:33.074322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 490/999] 10.222.0.88 () {56 vars in 1126 bytes} [Mon Aug 29 23:10:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:33.080960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:33.154329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:33.189081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34136c6b-ea4d-4688-bbd8-f4d1804768cf None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:33.224708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:33.225350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.225637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.225913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.226656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:33.226962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:33.228461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba045e3c-ce29-4a0c-a5c3-418d0cdbb718 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:33.233461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 510/1000] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:33.238954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:33.241896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228c366-b09e-49b2-a2b1-e48642aee813 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.242188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228c366-b09e-49b2-a2b1-e48642aee813 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.242469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228c366-b09e-49b2-a2b1-e48642aee813 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.244177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 511/1001] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:33.248856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.249169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.249451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.269600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:33.270933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:33.271595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:33.339564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 512/1002] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:33.344797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d4d6e-7440-4129-b9c6-e3cb867ea771 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:33.379313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:33.379972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.380256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.380530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.381180 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:33.381486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:33.382850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:33.388003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 491/1003] 10.222.0.88 () {56 vars in 1122 bytes} [Mon Aug 29 23:10:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:33.393569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:33.456053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:33.495222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b6919-49e4-4093-ac2d-69d5fc302476 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:33.528963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57013816-9c12-4893-a137-4471894db630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:33.529599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57013816-9c12-4893-a137-4471894db630 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.529880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57013816-9c12-4893-a137-4471894db630 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.530151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57013816-9c12-4893-a137-4471894db630 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.530819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57013816-9c12-4893-a137-4471894db630 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:33.532186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57013816-9c12-4893-a137-4471894db630 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:33.553213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 513/1004] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:33.619607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:33.722589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:33.731198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e01c-b089-40b9-900f-d105973b6a11 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:33.772409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:33.773048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.773361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.773636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] PATH_INFO: `/v3/services/image` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.774808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:33.776553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:33.785542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:33.786529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:33.787369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 492/1005] 10.222.0.88 () {56 vars in 1105 bytes} [Mon Aug 29 23:10:33 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:33.793156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57013816-9c12-4893-a137-4471894db630 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:33.896507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57013816-9c12-4893-a137-4471894db630 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:33.920648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:33.934038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:33.934661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:33.935112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:33.935395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:33.936030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] RBAC: Adding query filter params (name=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:33.936332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:33.937740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a999e-8d0b-4d54-8c23-be98efec9289 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:33.942919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 514/1006] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:33.948456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:34.024979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165b8b-92ba-49ca-ab66-27e6e5470289 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:34.025318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165b8b-92ba-49ca-ab66-27e6e5470289 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:34.025619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165b8b-92ba-49ca-ab66-27e6e5470289 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:34.027438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 515/1007] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:34.032390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:34.032680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:34.032958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:34.051923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:34.052312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97647-db0f-42b4-bd23-735e2841115b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:34.053130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:34.090202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:34.090805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:34.091140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:34.091351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:34.091968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] RBAC: Adding query filter params (type=image) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:34.092264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:34.093663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:34.098551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 493/1008] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:34.131576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 516/1009] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:34.403060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:34.426279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:34.505972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9d3d1-a615-4b7c-a851-7553cb11b488 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:34.540880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:34.541540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:34.541815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:34.542083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:34.542655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:34.544013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:34.553466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:34.554532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:34.555994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 494/1010] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:34.561090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:34.672918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aadd8-fa14-4132-9a4e-0f813c60a562 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:34.690988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:34.709164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:34.709775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:34.710057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:34.710331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:34.710954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] RBAC: Adding query filter params (name=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:34.711258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:34.712777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:34.723298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 517/1011] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:34.724527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:34.811360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:34.828090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71b35d-0fdb-49a6-af82-a5ab9c91623f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:34.861794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:34.862404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:34.862686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:34.862963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:34.863590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:34.863894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:34.865286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30cd16-f15c-47b6-aad7-c91464b5f8ca None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:34.871022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 495/1012] 10.222.0.88 () {56 vars in 1112 bytes} [Mon Aug 29 23:10:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:34.876551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:34.978274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832ee03-faeb-41c5-b0c9-3107be0591be None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:35.014092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785f006-bbe6-47ab-96e8-19df6c6ee221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:35.015658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785f006-bbe6-47ab-96e8-19df6c6ee221 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:35.015799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785f006-bbe6-47ab-96e8-19df6c6ee221 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:35.019152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785f006-bbe6-47ab-96e8-19df6c6ee221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:35.019152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785f006-bbe6-47ab-96e8-19df6c6ee221 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:35.019152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785f006-bbe6-47ab-96e8-19df6c6ee221 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:35.049143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 518/1013] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:35.486970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e65a-d61e-4e40-b468-c338bec9edaa None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:35.487377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e65a-d61e-4e40-b468-c338bec9edaa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:35.487567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e65a-d61e-4e40-b468-c338bec9edaa None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:35.488875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 496/1014] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:35.494054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:35.494503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:35.494680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:35.513195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:35.514369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:35.544803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:35.596907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 519/1015] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:35 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:35.861465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e65a-d61e-4e40-b468-c338bec9edaa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:35.963705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e65a-d61e-4e40-b468-c338bec9edaa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:35.997999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91382e8-8386-400e-bdf7-c5a410751b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:35.998622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91382e8-8386-400e-bdf7-c5a410751b2e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:35.998896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91382e8-8386-400e-bdf7-c5a410751b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:35.999164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91382e8-8386-400e-bdf7-c5a410751b2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:36.000262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91382e8-8386-400e-bdf7-c5a410751b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:36.001701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91382e8-8386-400e-bdf7-c5a410751b2e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:36.003417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 497/1016] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:36.009158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:36.061893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15992927-0451-4c71-9466-4e0d1338ba64 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:36.062210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15992927-0451-4c71-9466-4e0d1338ba64 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:36.062462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15992927-0451-4c71-9466-4e0d1338ba64 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:36.063781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 498/1017] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:36.068608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:36.068893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:36.069189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:36.088817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:36.090362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:36.102850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:36.112731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c16c-038d-4704-9889-c9add66f7904 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:36.149881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bba73-a8e0-4dd6-aab2-126ae5250d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:36.150583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bba73-a8e0-4dd6-aab2-126ae5250d1e None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:36.150768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bba73-a8e0-4dd6-aab2-126ae5250d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:36.151037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bba73-a8e0-4dd6-aab2-126ae5250d1e None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:36.152006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bba73-a8e0-4dd6-aab2-126ae5250d1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:36.153554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bba73-a8e0-4dd6-aab2-126ae5250d1e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:36.165544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 499/1018] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:36 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:36.189392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 520/1019] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:36 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:36.441821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:36.542939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40caf454-bd0c-4f56-86d8-96a10259a3cc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:36.578127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fd9a2-f44e-4470-b089-4cf38701d7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:36.578761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd9a2-f44e-4470-b089-4cf38701d7e5 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:36.579045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd9a2-f44e-4470-b089-4cf38701d7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:36.579322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fd9a2-f44e-4470-b089-4cf38701d7e5 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:36.579986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fd9a2-f44e-4470-b089-4cf38701d7e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:36.581381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fd9a2-f44e-4470-b089-4cf38701d7e5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:36.600176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 500/1020] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:10:36 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:37.067588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5848b5-9ccb-4211-8d7b-f99b4123098c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:37.068148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5848b5-9ccb-4211-8d7b-f99b4123098c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:37.068148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5848b5-9ccb-4211-8d7b-f99b4123098c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:37.069656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 521/1021] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:37.074785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b993-40e1-4792-9453-865d17468518 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:37.075172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b993-40e1-4792-9453-865d17468518 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:37.075516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17b993-40e1-4792-9453-865d17468518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:37.088355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:37.094571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3d17b993-40e1-4792-9453-865d17468518 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:37.096290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3d17b993-40e1-4792-9453-865d17468518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:37.171315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 501/1022] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:37.438056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5848b5-9ccb-4211-8d7b-f99b4123098c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:37.457277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:37.544552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5848b5-9ccb-4211-8d7b-f99b4123098c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:37.579186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:37.579821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:37.580103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:37.580489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:37.595441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:37.600264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:37.601501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:37.602341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:37.603425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 522/1023] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Aug 29 23:10:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:37.607351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b993-40e1-4792-9453-865d17468518 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:37.712408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17b993-40e1-4792-9453-865d17468518 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:37.742287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:37.748264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:37.748876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:37.749177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:37.749451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:37.750112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:37.750410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:37.751767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:37.764824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 502/1024] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:10:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:37.765992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:37.844752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:37.868567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a5e0-c813-48fa-ab66-8f0d3ede0812 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:37.903475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855542c-5920-4faf-9972-3a221901782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:37.904101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855542c-5920-4faf-9972-3a221901782c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:37.904379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855542c-5920-4faf-9972-3a221901782c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:37.904651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855542c-5920-4faf-9972-3a221901782c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:37.914573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855542c-5920-4faf-9972-3a221901782c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:37.916018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855542c-5920-4faf-9972-3a221901782c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2855542c-5920-4faf-9972-3a221901782c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:37.930703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:37.936856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:37.937868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:37.937868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:37.937868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:37.937868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 523/1025] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:37.938095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.038403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a401da-f440-4c1e-a269-d3dfcc6a2a7b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.072156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.072711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.072991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.073287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.073921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:38.074218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:38.075569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656857f-1f72-477a-bbc8-50b9f659e51c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:38.088165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 503/1026] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:38.093556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855542c-5920-4faf-9972-3a221901782c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.126829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8abe8-5df8-4860-9dfe-6b71f7a9b480 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.127140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8abe8-5df8-4860-9dfe-6b71f7a9b480 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.127379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8abe8-5df8-4860-9dfe-6b71f7a9b480 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.128698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 504/1027] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:38.133671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.133954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.134419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.152975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:38.154179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:38.205478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855542c-5920-4faf-9972-3a221901782c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.210019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:38.230359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 505/1028] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:38.234749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:38.243818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.244540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.244833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.245136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.252979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:38.254458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:38.265780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:38.266704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:38.272690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 524/1029] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:10:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:38.273325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.376087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b2a3-ff66-4c8d-99bb-511347a6118f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.411350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.411963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.412245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.412519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.413297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:38.413604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:38.415211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:38.437009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 506/1030] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:10:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:38.438306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.503479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.550122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:38.551242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1c1b6-1d6c-448c-ab5c-10e9b5d29296 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.584782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c227f7-a115-4a83-ba29-256c1ba9a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.585421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c227f7-a115-4a83-ba29-256c1ba9a393 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.585704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c227f7-a115-4a83-ba29-256c1ba9a393 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.585974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c227f7-a115-4a83-ba29-256c1ba9a393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.609895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b04c9-c0e6-4f75-b6fe-18240694e48b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.643559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:38.645350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c7c41-c41f-427d-ad90-9bcfbb822b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.646073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7c41-c41f-427d-ad90-9bcfbb822b2d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.646356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7c41-c41f-427d-ad90-9bcfbb822b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.646630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7c41-c41f-427d-ad90-9bcfbb822b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.647716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c7c41-c41f-427d-ad90-9bcfbb822b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:38.649751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670c7c41-c41f-427d-ad90-9bcfbb822b2d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:38.651663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 507/1031] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:38.652866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3089-845e-4a35-a540-ddf8aae4ae6e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.653315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3089-845e-4a35-a540-ddf8aae4ae6e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.653499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3089-845e-4a35-a540-ddf8aae4ae6e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.654677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 508/1032] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:38.657229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c3089-845e-4a35-a540-ddf8aae4ae6e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.658243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c227f7-a115-4a83-ba29-256c1ba9a393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:38.659723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c227f7-a115-4a83-ba29-256c1ba9a393 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:38.756004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 525/1033] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:38 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:38.756004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.756004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.756004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.766446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c3089-845e-4a35-a540-ddf8aae4ae6e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.776325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:38.777816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:38.778473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:38.806073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.806760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.807037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.807310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:38.807960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:38.809399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:38.839992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 509/1034] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:10:38 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:10:38.839992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:38.849528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 526/1035] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:38.957036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf50f0-4bb3-4030-9d33-443c620ee196 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:38.993427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:38.994153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:38.994436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:38.994715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.005535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.006973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:39.022073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:39.023024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:39.024048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:39.024048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:39.024048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:39.024048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 510/1036] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:39.030723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.052552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.125962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.146864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.148379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e735c5-e5fd-4cf4-9566-be3c939718a0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.205446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.206066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.206351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.206633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.207340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:39.207595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.208970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.226006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 527/1037] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:39.226937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.237827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023002e-b5a5-4aef-b9f8-42708cbf3a9d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.274913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.275545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.275825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.276099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] PATH_INFO: `/v3/services/image` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.276943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.278344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:39.287030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:39.288232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:39.289344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:39.293388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 511/1038] 10.222.0.88 () {56 vars in 1105 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:39.294600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.318592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.342308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b1c8a-c8b6-493f-83c4-8e09f7b06a14 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.380642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.381424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.381708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.381982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.387330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.389897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.391356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:39.403235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:39.404355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:39.405303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 528/1039] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:39.409967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.415071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451c3e1-b91f-451c-83a3-dd5e93ac9cfe None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.453097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.453817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.454169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.454522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.455256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:39.455663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.457185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.463035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 512/1040] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:39.468503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.518479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d50aa-ecc2-46be-bc2b-e6705b6b0e68 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.556898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.557539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.557819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.558090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.558780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:39.559093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.560516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.569150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.579914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 529/1041] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:39.580921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.582182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132787ca-f944-4ab8-8601-a82a3dcb9ff7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.625789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.626412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.626697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.626979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.627615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] RBAC: Adding query filter params (type=image) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:39.627917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.629330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.639328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 513/1042] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:39.640789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.656040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.696628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af70e1c-0406-487f-9061-07dfa9b29c0c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.731041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.731567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.731851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.732122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.732839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] RBAC: Adding query filter params (role.id=3128aa2c8b4a4baa96cb93a40a93c68e, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=ece70bdb48004d8bb17968453f12a6da) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:39.733167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.734593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.740140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 530/1043] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/role_assignments?user.id=ece70bdb48004d8bb17968453f12a6da&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=3128aa2c8b4a4baa96cb93a40a93c68e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:39.754098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194aa6-d599-4194-a7e6-e287782aef73 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.794319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.794959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.795241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.795515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.796227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] RBAC: Adding query filter params (interface=public, service_id=3b893bcb70084eaeabb2269c2cb47111, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:39.796537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.797962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa10844-f77c-48e2-8eb3-5783f3b922ca None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.808887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 514/1044] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/endpoints?service_id=3b893bcb70084eaeabb2269c2cb47111&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:39.810297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:39.878917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:39.922383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb27e32-96ce-4820-a0d8-3a7efe3e03b3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:39.956835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22b908-3c3c-4293-9d0b-c8158ef0b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:39.957478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22b908-3c3c-4293-9d0b-c8158ef0b56a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:39.957763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22b908-3c3c-4293-9d0b-c8158ef0b56a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:39.958037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22b908-3c3c-4293-9d0b-c8158ef0b56a None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:39.958644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22b908-3c3c-4293-9d0b-c8158ef0b56a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:39.960014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22b908-3c3c-4293-9d0b-c8158ef0b56a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:39.967171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 531/1045] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:10:39 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:10:40.822852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82494f-e741-49cd-8d47-6522cd044e97 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:40.823395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82494f-e741-49cd-8d47-6522cd044e97 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:40.823395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82494f-e741-49cd-8d47-6522cd044e97 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:40.824867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 515/1046] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:40.829995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:40.830368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:40.830549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:40.849122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:40.850319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:40.917224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 532/1047] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:41.199549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82494f-e741-49cd-8d47-6522cd044e97 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:41.278567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:41.305459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82494f-e741-49cd-8d47-6522cd044e97 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:41.339565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:41.340196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.340471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.340738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.351322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:41.356063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:41.356987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:41.358177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:41.361433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 516/1048] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:41.363162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:41.419772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:41.464603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78677b1b-6638-4d64-b56e-482d0abbe46c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:41.498554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:41.499165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.499441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.499711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.500437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:41.500820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:41.502231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68efda7-cb68-4c1d-b27a-f59ead401343 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:41.511395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 533/1049] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:41.517017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:41.641338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb8953-7be2-43da-91db-486b79ec9c3d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:41.647572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95fb80-a0df-4ded-aaef-da06d9816032 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.647859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95fb80-a0df-4ded-aaef-da06d9816032 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.648139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95fb80-a0df-4ded-aaef-da06d9816032 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.650442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 534/1050] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:41.655993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4bd5-b756-42a0-9573-6b5dc9de7d48 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.656518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4bd5-b756-42a0-9573-6b5dc9de7d48 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.657019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4bd5-b756-42a0-9573-6b5dc9de7d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.679730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-23de4bd5-b756-42a0-9573-6b5dc9de7d48 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:41.685847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23de4bd5-b756-42a0-9573-6b5dc9de7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:41.698405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:41.699448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.699929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.700401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] PATH_INFO: `/v3/users/1de196490fae4381a9072e74b1f5bf52` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.702849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:41.718760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] RBAC: Authorizing `identity:get_user(user_id=1de196490fae4381a9072e74b1f5bf52)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:41.720568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:41.722884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 517/1051] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:41 2022] GET /identity/v3/users/1de196490fae4381a9072e74b1f5bf52 => generated 285 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:41.728855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:41.787085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 535/1052] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:41.864197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706f03-cb7e-4362-9599-b35ff209c85f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:41.884918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0264-734c-4f7e-92c9-559362251990 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.886000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0264-734c-4f7e-92c9-559362251990 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.886531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa0264-734c-4f7e-92c9-559362251990 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.891893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 536/1053] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:41.893721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.894315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.894783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.904850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:41.905506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:41.905781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:41.906048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:41.918478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:41.919666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:41.972787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:41.975669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:41.986782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:41.988459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:41.999332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 537/1054] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:42.068231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.092751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 518/1055] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:10:42.099317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.182641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9546dfb-51ae-48a3-83b4-f3ded9a378de None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.195041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.209171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c9d7-86dc-4ba9-bd0d-1afe68cda278 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.218290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.218922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.219203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.219479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.234355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:42.241906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:42.243582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:42.245391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 538/1056] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:42.248595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.249262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.249544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.249821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.249986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.250931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.252356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.257161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 519/1057] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:42.260109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.291257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.351468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808a2bd-604e-4ad6-9d93-68305e889ec8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.359863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880226f2-50b7-4f79-bd3c-c96f94dd8dc4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.385925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.386529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.386819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.387091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.387894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:42.388197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.389609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.394400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.395072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.395355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.395627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.396379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e, user.id=1de196490fae4381a9072e74b1f5bf52) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:42.396687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.397675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 539/1058] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:42.398211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.402258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.404351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 520/1059] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/role_assignments?user.id=1de196490fae4381a9072e74b1f5bf52&scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:42.405022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.442804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.516352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.519288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4593345-63b5-4e43-a0fb-e3a4230d3069 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.534980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182e0e1-d61a-48f8-91a5-16d39266d0cb None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.568929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.569621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.569903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.570178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] PATH_INFO: `/v3/services/image` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.570846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.572109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.572716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.572816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.573009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.573311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:42.582060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:42.583067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:42.583927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 540/1060] 10.222.0.88 () {56 vars in 1105 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:42.589164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.590717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.592606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:42.609699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:42.610698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:42.612665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:42.612665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:42.612665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:42.612665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 521/1061] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:42.616500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.702839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abfeaa-d22e-4350-ad3e-539a0b6ee879 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.703324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.730854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19d70-54ff-4f49-afaa-24b1cf71c299 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.740038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.740864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.741177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.741454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.742084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:42.742386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.744759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.753156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 541/1062] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:42.755499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.771168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.771720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.772003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.772281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.772955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:42.773304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.775309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.787898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 522/1063] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:42.788890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.794610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.877018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd572-2428-4aa1-87d8-fb4c7c62dda2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.903423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55158875-f4ff-4b95-817d-fcab5b766490 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:42.914188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.915375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.915676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.915931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.916559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] RBAC: Adding query filter params (type=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:42.916860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.918496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.928426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 542/1064] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:42.929287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:42.939383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:42.940018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:42.940300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:42.940573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:42.944970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:42.950441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:42.952107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:42.963858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:42.964821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 523/1065] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:42.970876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:43.035440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:43.046206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca29972-d254-47a5-a9a6-74c65fbba867 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:43.082230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab80b5-a308-469b-b67f-498129cd79c6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:43.084368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:43.085647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:43.085930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:43.086255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:43.087570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:43.088994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:43.118237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 543/1066] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:10:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:43.138742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:43.139376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:43.139657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:43.139984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:43.140731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:43.141040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:43.142562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:43.168961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 524/1067] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:10:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:43.170471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:43.291629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124bdc7-1cd0-4d2a-b067-f3723e9f78b9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:43.325832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:43.326470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:43.326749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:43.327021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:43.338500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:43.339953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:43.348195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:43.356484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:43.357534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:43.358462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:43.358462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:43.358462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:43.358462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 544/1068] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:43.363865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:43.417199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:43.469358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ffac1-0a24-4b8b-b6d9-d7a4d56b6bf8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:43.504981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:43.505615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:43.505895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:43.506168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:43.506803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:43.507101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:43.508730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:43.520202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 525/1069] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:43.526305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:43.637892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aee57e-66af-42df-82d7-dc11bd22e668 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:43.672884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:43.673553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:43.673835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:43.674109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:43.680962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:43.682448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:43.693525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:43.694438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:43.695375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 545/1070] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:43.702383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:43.803906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87405c1c-4d1d-4916-93e5-9844b2081df6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:43.814964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:43.841781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:43.842390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:43.842671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:43.842945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:43.843631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:43.843939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:43.845405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb328-7b30-4a8f-9ca2-0221cd289775 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:43.862720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 526/1071] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:43.863897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:43.926096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:43.969523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39365a4-f2cd-4ce1-883b-413ed87c278f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:44.004002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ddf8e-d845-42dd-b166-44eb77fa3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:44.004670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ddf8e-d845-42dd-b166-44eb77fa3645 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:44.004954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ddf8e-d845-42dd-b166-44eb77fa3645 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:44.005270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ddf8e-d845-42dd-b166-44eb77fa3645 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/ece70bdb48004d8bb17968453f12a6da/roles/3128aa2c8b4a4baa96cb93a40a93c68e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:44.007405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ddf8e-d845-42dd-b166-44eb77fa3645 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=ece70bdb48004d8bb17968453f12a6da, role_id=3128aa2c8b4a4baa96cb93a40a93c68e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:44.009607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ddf8e-d845-42dd-b166-44eb77fa3645 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:44.022492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 546/1072] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:43 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/ece70bdb48004d8bb17968453f12a6da/roles/3128aa2c8b4a4baa96cb93a40a93c68e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:10:44.304689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4a384-6ee5-44ed-8e62-69935337e63c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:44.305252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4a384-6ee5-44ed-8e62-69935337e63c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:44.305349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4a384-6ee5-44ed-8e62-69935337e63c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:44.306854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 527/1073] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:44.311852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:44.312143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:44.312419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:44.330931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:44.332105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:44.401476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 547/1074] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:44.670164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4a384-6ee5-44ed-8e62-69935337e63c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:44.772815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4a384-6ee5-44ed-8e62-69935337e63c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:44.807849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:44.808466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:44.808735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:44.808997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:44.818926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:44.824018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:44.824950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:44.826138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:44.829417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 528/1075] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:44.831001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:44.881140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:44.932038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89271e5a-2c2f-47d3-829f-80283f949d33 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:44.965808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:44.966366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:44.966644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:44.966915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:44.967576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:44.967874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:44.969255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb2d75-4b97-4368-b917-0704a3fcb5b9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:44.981149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 548/1076] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:44.985224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:45.019309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:45.096483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f6b6-e7bd-4410-9d7a-280bf44d861e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:45.106546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483abbe6-b77a-4261-b12f-bcff023bf46d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.106878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483abbe6-b77a-4261-b12f-bcff023bf46d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.107112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483abbe6-b77a-4261-b12f-bcff023bf46d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.108594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 549/1077] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:45.113462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.113752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.114032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.133705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:45.134936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:45.137123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:45.137772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.138054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.138333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] PATH_INFO: `/v3/users/1de196490fae4381a9072e74b1f5bf52` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.139466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] RBAC: Authorizing `identity:get_user(user_id=1de196490fae4381a9072e74b1f5bf52)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:45.140899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:45.153362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 529/1078] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:44 2022] GET /identity/v3/users/1de196490fae4381a9072e74b1f5bf52 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:45.160382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:45.210488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 550/1079] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:45.267714 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:45.271847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770aa6-aeab-490c-84b7-cf8d10d3115e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:45.308631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:45.309271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.309554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.309828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.310944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] RBAC: Authorizing `identity:get_project(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:45.312366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:45.314187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 530/1080] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:10:45 2022] GET /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:45.320063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:45.365744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:45.424569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bf69f-3a75-49b6-b95d-26d4af055d82 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:45.459231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:45.459891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.460171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.460445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e/users/1de196490fae4381a9072e74b1f5bf52/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.463105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e, user_id=1de196490fae4381a9072e74b1f5bf52, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:45.464544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:45.481187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 551/1081] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:45 2022] PUT /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e/users/1de196490fae4381a9072e74b1f5bf52/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:10:45.481597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:45.596692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463961e-7e19-4ca9-9215-c31cbae31d2f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:45.636367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba163-c029-4743-9985-bb12aee65549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:45.636990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba163-c029-4743-9985-bb12aee65549 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.637903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba163-c029-4743-9985-bb12aee65549 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.638179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba163-c029-4743-9985-bb12aee65549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.674268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:45.711142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba163-c029-4743-9985-bb12aee65549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:45.712835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba163-c029-4743-9985-bb12aee65549 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:45.813179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 531/1082] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:10:45.818696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:45.921698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0b216-431b-4799-8a80-5bf3b1d803f0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:45.923255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:45.942370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4c050-52eb-4ebf-8509-7b259141ff56 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.942370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4c050-52eb-4ebf-8509-7b259141ff56 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.942370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4c050-52eb-4ebf-8509-7b259141ff56 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.943039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 532/1083] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:10:45.948763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.949043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.949346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.962258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:45.962933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:45.963130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:45.963347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:45.967895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:45.969061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:45.973647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:45.975108 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:45.990415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:45.991418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:45.993058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:45.993058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:45.993058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:45.993058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 552/1084] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:45.997593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:46.037656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:46.048336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 533/1085] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:46.100272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379f150-8480-49ee-a6c4-7c9141ee82e0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:46.134796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:46.135355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:46.135637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:46.135911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:46.136556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:46.136857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:46.138336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:46.149846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 553/1086] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:46.317236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:46.422490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409f247-2582-490d-b0e9-e94f9d7a1703 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:46.457274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:46.457908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:46.458190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:46.458465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:46.469122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:46.473984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:46.475012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:46.475839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 534/1087] 10.222.0.88 () {56 vars in 1120 bytes} [Mon Aug 29 23:10:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:46.481937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:46.498226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:46.583195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aea676-0436-45d6-9dac-e9be5fc24844 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:46.616948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:46.618053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:46.618334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:46.618610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:46.619270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:46.619573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:46.620952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:46.629196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 554/1088] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:10:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:46.635607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:46.691816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:46.735813 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740962-ab38-4d89-97ef-0906004c84ed None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:46.768836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:46.769486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:46.769766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:46.770038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:46.781297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:46.782849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:46.796953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:46.797899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:46.798794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:46.798794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:46.798794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:46.798794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 535/1089] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:46.804228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:46.880967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:46.905016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7ea41-824b-4693-ac8e-56aef5865aee None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:46.940504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:46.941125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:46.941426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:46.941703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:46.942345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:46.942651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:46.944018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:46.956176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 555/1090] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:46.961876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.062654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79589dd-b0ef-4d3d-aab4-0b589f8ea57a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:47.072035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:47.097530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:47.098158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.098438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.098711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.106344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:47.107780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:10:47.119347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:47.120542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:47.121544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 536/1091] 10.222.0.88 () {56 vars in 1093 bytes} [Mon Aug 29 23:10:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:47.126343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.229158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabeae3-0135-457d-bcaa-7d68d7f81cf7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:47.263596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:47.264201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.264483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.264834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.265703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:47.266008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:47.267435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f9ad4-90e4-475d-9264-27f7c37818bf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:47.269997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:47.285942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 556/1092] 10.222.0.88 () {56 vars in 1133 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:47.292310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.389312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1327-68f3-468a-af81-635a0e6943ca None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:47.398152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501542-4a6b-44c0-b2a4-9705cb4ad105 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.398441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501542-4a6b-44c0-b2a4-9705cb4ad105 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.398738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501542-4a6b-44c0-b2a4-9705cb4ad105 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.400718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 557/1093] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:47.405737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.406022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.406299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.423258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:47.423867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.423977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:47.424144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.424412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.425059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:47.457866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:47.491308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:47.492318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 558/1094] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:10:47.492725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:47.588218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 537/1095] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:10:47.593772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.690062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d0ad6-a3d3-4138-9f31-23cd5e4ce9a3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:47.712737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:47.723394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:47.724011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.724286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.724554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.734312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:47.735740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:10:47.750312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:47.751467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:10:47.752389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:10:47.752389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:10:47.752389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:47.752389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 559/1096] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:10:47.757204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.762274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.824522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:47.857534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336df89d-bbfa-47b7-8c18-67ca5c250222 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:47.862967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f8e5-c934-4aa3-9893-8e882b5d77f5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:47.892515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:47.893117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.893417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.893687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.894311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:47.894606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:47.896026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:47.896860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:47.897525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:47.897809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:47.898087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:47.908127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 538/1097] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:47.909208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:10:47.913645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:10:47.914221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:47.915411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:10:47.918224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 560/1098] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:47.921304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:47.956499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.018564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d77a3-6146-453f-a2fa-a9779484a0a6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.021551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5411282-68a4-4cb3-b72f-6b13c8be6f22 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.044158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.052289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.052912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.053280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.053552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.054923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.056234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.056514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.056795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.057488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:48.057799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.059163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.061052 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.062830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.067707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 561/1099] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:48.074046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:10:48.075549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:10:48.076613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:10:48.077763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 539/1100] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:10:48.082253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:48.171611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.175515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aaa5f-1931-428e-9599-7feab98a5824 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.184950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1e970-5177-40ee-9848-1298b58805b9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.209498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.210129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.210410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.210723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] PATH_INFO: `/v3/users/1de196490fae4381a9072e74b1f5bf52` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.211967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] RBAC: Authorizing `identity:get_user(user_id=1de196490fae4381a9072e74b1f5bf52)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.213434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.215022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 562/1101] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:48 2022] GET /identity/v3/users/1de196490fae4381a9072e74b1f5bf52 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:48.220813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:48.221141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.221785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.222065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.222339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.223033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:48.223334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.224757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.237536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 540/1102] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:10:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:48.243996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:48.291874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.324426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a8e01-d908-4f6d-baac-086ae3f8b7de None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.342437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afc44a-92ff-445f-a8b7-fea13e82fc0b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.358118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.358727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.359015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.359289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.377017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.377640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.377921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.378193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.378907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] RBAC: Adding query filter params (role.id=3128aa2c8b4a4baa96cb93a40a93c68e, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=ece70bdb48004d8bb17968453f12a6da) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:48.379211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.380625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.386899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 541/1103] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:48 2022] GET /identity/v3/role_assignments?user.id=ece70bdb48004d8bb17968453f12a6da&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=3128aa2c8b4a4baa96cb93a40a93c68e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:10:48.396327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.437909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.439403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.547899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 563/1104] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:10:48.553674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:48.663786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f1d7-d43a-42da-82ae-58fe712937cf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.685128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.699564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51805b0-63d3-454d-8b8b-17c6a894d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.700200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51805b0-63d3-454d-8b8b-17c6a894d365 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.700480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51805b0-63d3-454d-8b8b-17c6a894d365 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.700753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51805b0-63d3-454d-8b8b-17c6a894d365 None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.701910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51805b0-63d3-454d-8b8b-17c6a894d365 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.703342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51805b0-63d3-454d-8b8b-17c6a894d365 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.705134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 542/1105] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:10:48 2022] GET /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:48.711851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:48.779091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:48.816432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4ebd1-3c74-41e6-b195-2e93777f0d0d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:48.851603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:48.852872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:48.853239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:48.853522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:48.854250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e, user.id=1de196490fae4381a9072e74b1f5bf52) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:48.854561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:48.855985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5c4f9-6a57-4528-84b8-10fbf8047663 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:48.862043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 564/1106] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:48 2022] GET /identity/v3/role_assignments?user.id=1de196490fae4381a9072e74b1f5bf52&scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:50.768772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517e21-488d-4e43-8622-8be417a4ec6d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:50.769348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517e21-488d-4e43-8622-8be417a4ec6d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:50.769348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517e21-488d-4e43-8622-8be417a4ec6d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:50.770660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 543/1107] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:50.775760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:50.776136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:50.776299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:50.794492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:50.795664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:50.859695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 565/1108] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:51.128255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517e21-488d-4e43-8622-8be417a4ec6d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:51.232681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517e21-488d-4e43-8622-8be417a4ec6d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:51.265466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad4fb-a72e-48be-ab19-8403f8b5c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:51.266088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad4fb-a72e-48be-ab19-8403f8b5c19c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:51.266370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad4fb-a72e-48be-ab19-8403f8b5c19c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:51.266647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad4fb-a72e-48be-ab19-8403f8b5c19c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:51.267758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad4fb-a72e-48be-ab19-8403f8b5c19c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:51.269230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad4fb-a72e-48be-ab19-8403f8b5c19c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:51.270788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 544/1109] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:51.276581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:51.334708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:51.375117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f0c1-3edf-4ab9-bf53-3dca6adb663f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:51.408086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3ed71-6f1a-40c9-858f-bd1673082292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:51.408627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3ed71-6f1a-40c9-858f-bd1673082292 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:51.408907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3ed71-6f1a-40c9-858f-bd1673082292 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:51.409281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3ed71-6f1a-40c9-858f-bd1673082292 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:51.409920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3ed71-6f1a-40c9-858f-bd1673082292 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:51.411342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3ed71-6f1a-40c9-858f-bd1673082292 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:51.432977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 566/1110] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:10:51 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:10:53.394318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fe1db-3aed-4b53-ac1a-4dfbac04b8a1 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:53.394917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fe1db-3aed-4b53-ac1a-4dfbac04b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:53.394917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fe1db-3aed-4b53-ac1a-4dfbac04b8a1 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:53.396183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 545/1111] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:53.401484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:53.402183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:53.402284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:53.420794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:53.422003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:53.486682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 567/1112] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:53.757533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fe1db-3aed-4b53-ac1a-4dfbac04b8a1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:53.806466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:53.856481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fe1db-3aed-4b53-ac1a-4dfbac04b8a1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:53.888140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:53.888754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:53.889027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:53.889344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] PATH_INFO: `/v3/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:53.890688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] RBAC: Authorizing `identity:get_role(role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:53.892042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:53.893369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 546/1113] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:53 2022] GET /identity/v3/roles/735d69de30e14d03a5a17f594ad42f5a => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:53.899988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:53.946706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:54.000916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a2d9c-3a4e-41d0-af57-e186b5458ffd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:54.033613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:54.034232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:54.034510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:54.034784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] PATH_INFO: `/v3/users/a48d421789954b2f9a3bc60401c73f3e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:54.047962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] RBAC: Authorizing `identity:get_user(user_id=a48d421789954b2f9a3bc60401c73f3e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:54.049440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:54.051003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 568/1114] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:53 2022] GET /identity/v3/users/a48d421789954b2f9a3bc60401c73f3e => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:54.056999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:54.153325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adcdb4-20a6-46b8-aebf-234677fd2b9a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:54.168476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:54.185584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:54.186173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:54.186448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:54.186719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:54.250692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:54.252124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:54.346065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 547/1115] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:10:54.352043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:54.449034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bad9-b276-4d56-81b0-992300aeb98d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:54.451387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:54.481931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b06c7-6408-4aa7-991d-a3219d050250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:54.482546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b06c7-6408-4aa7-991d-a3219d050250 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:54.482822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b06c7-6408-4aa7-991d-a3219d050250 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:54.483092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b06c7-6408-4aa7-991d-a3219d050250 None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:54.484180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b06c7-6408-4aa7-991d-a3219d050250 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:54.485626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b06c7-6408-4aa7-991d-a3219d050250 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:54.487232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 569/1116] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:10:54 2022] GET /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:54.494145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:54.512181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:54.592838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb0324-fa76-4e3e-bf21-b3bc161f3c4f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:54.626319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:54.626919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:54.627196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:54.627464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:54.628179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] RBAC: Adding query filter params (role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e, user.id=a48d421789954b2f9a3bc60401c73f3e) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:10:54.628482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:54.629925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c3936-ab5b-40b6-9df1-fda8dc7b05a0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:54.635660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 548/1117] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:10:54 2022] GET /identity/v3/role_assignments?user.id=a48d421789954b2f9a3bc60401c73f3e&scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:56.496855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd8f1-0dce-4f9e-974a-716a655c9f09 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:56.497449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd8f1-0dce-4f9e-974a-716a655c9f09 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:56.497449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd8f1-0dce-4f9e-974a-716a655c9f09 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:56.498819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 570/1118] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:56.503987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:56.504482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:56.504573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:56.522961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:56.524768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:56.589833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 549/1119] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:56.855008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd8f1-0dce-4f9e-974a-716a655c9f09 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:56.955629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd8f1-0dce-4f9e-974a-716a655c9f09 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:56.987959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:56.988580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:56.988867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:56.989164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] PATH_INFO: `/v3/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:56.990586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] RBAC: Authorizing `identity:get_role(role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:56.991938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:56.993928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 571/1120] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:56 2022] GET /identity/v3/roles/735d69de30e14d03a5a17f594ad42f5a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:57.000475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:57.013019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:57.098718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5cd3d-9a8d-48af-a789-d3f0b1ded692 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:57.131994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:57.132553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:57.132833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:57.133170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] PATH_INFO: `/v3/users/a48d421789954b2f9a3bc60401c73f3e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:57.134441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] RBAC: Authorizing `identity:get_user(user_id=a48d421789954b2f9a3bc60401c73f3e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:57.135872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:57.137462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 550/1121] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:56 2022] GET /identity/v3/users/a48d421789954b2f9a3bc60401c73f3e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:57.143263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:57.184888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:57.241628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fd7b5-0cd0-4153-a85a-958c6fdc1577 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:57.276463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24acba-767f-4f01-8eb0-0fb8e8b3f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:57.277383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24acba-767f-4f01-8eb0-0fb8e8b3f84d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:57.277669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24acba-767f-4f01-8eb0-0fb8e8b3f84d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:57.277949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24acba-767f-4f01-8eb0-0fb8e8b3f84d None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:57.279057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24acba-767f-4f01-8eb0-0fb8e8b3f84d None admin] RBAC: Authorizing `identity:get_project(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:57.280502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24acba-767f-4f01-8eb0-0fb8e8b3f84d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:57.282177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 572/1122] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:10:57 2022] GET /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:57.288146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:57.364572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:57.386475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606d881-534a-49d3-a253-28f995c9bf69 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:57.419591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e2580-12df-4f95-915e-7ca5ce8c45fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:57.420237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2580-12df-4f95-915e-7ca5ce8c45fa None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:57.420520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2580-12df-4f95-915e-7ca5ce8c45fa None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:57.420796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e2580-12df-4f95-915e-7ca5ce8c45fa None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e/users/a48d421789954b2f9a3bc60401c73f3e/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:57.422919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e2580-12df-4f95-915e-7ca5ce8c45fa None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e, user_id=a48d421789954b2f9a3bc60401c73f3e, role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:57.424340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e2580-12df-4f95-915e-7ca5ce8c45fa None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:57.438038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 551/1123] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:10:57 2022] PUT /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e/users/a48d421789954b2f9a3bc60401c73f3e/roles/735d69de30e14d03a5a17f594ad42f5a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:10:59.293737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9551369-ef2b-4c95-98fa-20f35e827cf4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:59.294289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9551369-ef2b-4c95-98fa-20f35e827cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:59.294289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9551369-ef2b-4c95-98fa-20f35e827cf4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:59.295684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 573/1124] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:10:59.300784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:59.301189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:59.301353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:59.319216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:10:59.320880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:10:59.384841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 552/1125] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:10:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:10:59.651306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9551369-ef2b-4c95-98fa-20f35e827cf4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:59.751981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9551369-ef2b-4c95-98fa-20f35e827cf4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:59.760931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:59.785801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:59.786422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:59.786706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:59.786980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] PATH_INFO: `/v3/roles/735d69de30e14d03a5a17f594ad42f5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:59.788361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] RBAC: Authorizing `identity:get_role(role_id=735d69de30e14d03a5a17f594ad42f5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:59.790422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:59.791733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 574/1126] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:59 2022] GET /identity/v3/roles/735d69de30e14d03a5a17f594ad42f5a => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:59.797571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:10:59.860875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:10:59.892615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d588a-0024-4c1e-8342-cdc4e2f5dfe2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:10:59.926577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:10:59.927196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:10:59.927473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:10:59.927744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] PATH_INFO: `/v3/users/a48d421789954b2f9a3bc60401c73f3e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:10:59.928844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] RBAC: Authorizing `identity:get_user(user_id=a48d421789954b2f9a3bc60401c73f3e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:10:59.930693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:10:59.932258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 553/1127] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:10:59 2022] GET /identity/v3/users/a48d421789954b2f9a3bc60401c73f3e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:10:59.938197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:00.035785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6805cd-cf71-4bc8-af1c-bf48a192172b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:00.067649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:00.068232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:00.068510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:00.068780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:00.112612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:00.135225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:00.136675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:00.232271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 575/1128] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:10:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:11:00.238134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:00.335835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20049e6-6493-47ed-b206-2d111b1f5187 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:00.368727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04c0e7-7862-4173-9beb-a154a157ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:00.369445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c0e7-7862-4173-9beb-a154a157ad97 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:00.369728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c0e7-7862-4173-9beb-a154a157ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:00.370003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04c0e7-7862-4173-9beb-a154a157ad97 None admin] PATH_INFO: `/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:00.371114 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04c0e7-7862-4173-9beb-a154a157ad97 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b2a5d56ced44d28b7d0b2d8f26429e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:00.372542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04c0e7-7862-4173-9beb-a154a157ad97 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:00.374176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 554/1129] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:00 2022] GET /identity/v3/projects/f8b2a5d56ced44d28b7d0b2d8f26429e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:00.380275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:00.455454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:00.478273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d52914-899f-4c02-8d37-3b0f4dfe233b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:00.511475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:00.512001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:00.512278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:00.512550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:00.513384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] RBAC: Adding query filter params (role.id=735d69de30e14d03a5a17f594ad42f5a, scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e, user.id=a48d421789954b2f9a3bc60401c73f3e) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:00.513694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:00.515107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770878b5-6210-44f1-a041-7d77fdd7504d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:00.520674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 576/1130] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:11:00 2022] GET /identity/v3/role_assignments?user.id=a48d421789954b2f9a3bc60401c73f3e&scope.project.id=f8b2a5d56ced44d28b7d0b2d8f26429e&role.id=735d69de30e14d03a5a17f594ad42f5a => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:02.407745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e5f8-e8e5-4542-936f-a06a24c8fd99 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:02.408284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e5f8-e8e5-4542-936f-a06a24c8fd99 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:02.408284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e5f8-e8e5-4542-936f-a06a24c8fd99 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:02.409639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 555/1131] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:02.415560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:02.415945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:02.416131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:02.434595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:02.435842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:02.502528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 577/1132] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:02.780244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e5f8-e8e5-4542-936f-a06a24c8fd99 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:02.784017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:02.881184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e5f8-e8e5-4542-936f-a06a24c8fd99 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:02.915736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391de34-53db-40bf-b6d0-eb3afdc748fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:02.916353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391de34-53db-40bf-b6d0-eb3afdc748fa None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:02.916634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391de34-53db-40bf-b6d0-eb3afdc748fa None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:02.916909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391de34-53db-40bf-b6d0-eb3afdc748fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:02.918062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391de34-53db-40bf-b6d0-eb3afdc748fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:02.919486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391de34-53db-40bf-b6d0-eb3afdc748fa None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:02.921031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 556/1133] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:11:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:02.926880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:02.993456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:03.023296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f954a-5b6d-4101-a92f-c9e46cc6ac68 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:03.056940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cdd4d-53f6-4a5b-b7d4-8f4ebf2b961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:03.057563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cdd4d-53f6-4a5b-b7d4-8f4ebf2b961b None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:03.057845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cdd4d-53f6-4a5b-b7d4-8f4ebf2b961b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:03.058127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cdd4d-53f6-4a5b-b7d4-8f4ebf2b961b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:03.058765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cdd4d-53f6-4a5b-b7d4-8f4ebf2b961b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:03.060201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cdd4d-53f6-4a5b-b7d4-8f4ebf2b961b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:03.087502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 578/1134] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:11:02 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:11:04.998104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0cba3-d788-42cf-ac14-1c5551dc6d4f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:04.998605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0cba3-d788-42cf-ac14-1c5551dc6d4f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:04.998605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0cba3-d788-42cf-ac14-1c5551dc6d4f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:04.999892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 557/1135] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:05.005033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:05.005458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:05.005624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:05.023360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:05.025048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:05.089291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 579/1136] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:05.358777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0cba3-d788-42cf-ac14-1c5551dc6d4f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:05.429376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:05.460343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0cba3-d788-42cf-ac14-1c5551dc6d4f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:05.494023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b0684-d58d-4bdc-bfb2-8dcf111a0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:05.494658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b0684-d58d-4bdc-bfb2-8dcf111a0f41 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:05.494934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b0684-d58d-4bdc-bfb2-8dcf111a0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:05.495203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b0684-d58d-4bdc-bfb2-8dcf111a0f41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:05.496299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b0684-d58d-4bdc-bfb2-8dcf111a0f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:05.497788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b0684-d58d-4bdc-bfb2-8dcf111a0f41 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:05.499340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 558/1137] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:11:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:05.505198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:05.556906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:05.604069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e80b-ed77-499a-aa95-5facc9429000 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:05.637700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae4486-99b9-4da9-be88-14890b82e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:05.638310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae4486-99b9-4da9-be88-14890b82e2af None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:05.638594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae4486-99b9-4da9-be88-14890b82e2af None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:05.638871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae4486-99b9-4da9-be88-14890b82e2af None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:05.639531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae4486-99b9-4da9-be88-14890b82e2af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:05.640965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae4486-99b9-4da9-be88-14890b82e2af None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:05.661922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 580/1138] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:11:05 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:11:07.610375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975baa-ec63-4fd6-ab7e-2af5d323aa5c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:07.610943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975baa-ec63-4fd6-ab7e-2af5d323aa5c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:07.610943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975baa-ec63-4fd6-ab7e-2af5d323aa5c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:07.612238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 559/1139] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:07.617467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:07.617894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:07.617993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:07.636161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:07.637354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:07.701477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 581/1140] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:07.971448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd975baa-ec63-4fd6-ab7e-2af5d323aa5c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:08.068842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd975baa-ec63-4fd6-ab7e-2af5d323aa5c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:08.101016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:08.101830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:08.102109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:08.102379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:08.109612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:08.112876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:11:08.118381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:08.119644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:11:08.120575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 560/1141] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:08.125411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:08.164393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:08.223779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d59c1-e083-4dfb-af55-b569c072e063 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:08.257339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:08.258498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:08.258786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:08.259060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:08.259722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:08.260025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:08.261419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:08.269372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 582/1142] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:11:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:08.275935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:08.373418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729d01-4ed5-454f-b4d7-bd3bc4f2af16 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:08.406544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:08.407158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:08.407439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:08.407715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] PATH_INFO: `/v3/users/dcc58961b3f041a085760a4183f3648e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:08.421003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc58961b3f041a085760a4183f3648e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:08.422471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:08.424063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 561/1143] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:11:08 2022] GET /identity/v3/users/dcc58961b3f041a085760a4183f3648e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:08.430419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:08.533395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:08.537539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f2e3-837d-48b4-a75f-b5ae88d72ee5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:08.575328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:08.575939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:08.576225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:08.576508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:08.659605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:08.661985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:08.766776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:08.770694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 583/1144] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:11:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:11:08.776601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:08.835191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:08.878058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88417e-932e-4370-9a6f-fa514813ada8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:08.913231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463006-9b52-4bef-a5bc-e784bfed68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:08.913852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463006-9b52-4bef-a5bc-e784bfed68b2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:08.914254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463006-9b52-4bef-a5bc-e784bfed68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:08.914532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463006-9b52-4bef-a5bc-e784bfed68b2 None admin] PATH_INFO: `/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:08.916703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463006-9b52-4bef-a5bc-e784bfed68b2 None admin] RBAC: Authorizing `identity:get_project(project_id=7ffd0d816ae14d0fac7a4a796ab57c1a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:08.918156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463006-9b52-4bef-a5bc-e784bfed68b2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:08.919767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 562/1145] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:08 2022] GET /identity/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:08.926537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:09.033770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b66f5-6c87-4282-beec-a4487256080d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:09.074445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:09.075043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:09.075321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:09.075591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:09.076318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=7ffd0d816ae14d0fac7a4a796ab57c1a, user.id=dcc58961b3f041a085760a4183f3648e) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:09.076620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:09.078095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee74e3-c162-43f5-a8c4-cc946370df04 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:09.083867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 584/1146] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:11:08 2022] GET /identity/v3/role_assignments?user.id=dcc58961b3f041a085760a4183f3648e&scope.project.id=7ffd0d816ae14d0fac7a4a796ab57c1a&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:11.000907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a6127-aa91-4f05-bcf3-53a5cf080f42 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:11.001522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a6127-aa91-4f05-bcf3-53a5cf080f42 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:11.001522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a6127-aa91-4f05-bcf3-53a5cf080f42 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:11.002889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 563/1147] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:11.009307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:11.009758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:11.009850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:11.034488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:11.035725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:11.103343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:11.113408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 585/1148] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:11:11.469270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a6127-aa91-4f05-bcf3-53a5cf080f42 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:11.568461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a6127-aa91-4f05-bcf3-53a5cf080f42 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:11.594268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:11.603202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:11.603836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:11.604117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:11.604392 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:11.614305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:11:11.619228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:11.620363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:11:11.621699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 564/1149] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:11.626438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:11.723798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c8f7d-ae5a-4260-a1fd-ef986d691770 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:11.757031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:11.757668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:11.758679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:11.759029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:11.759693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:11.759999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:11.761396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:11.769191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 586/1150] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:11.775217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:11.872295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2994-4483-4ed8-a40a-e9801515047b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:11.905459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:11.906078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:11.906354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:11.906623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] PATH_INFO: `/v3/users/dcc58961b3f041a085760a4183f3648e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:11.907718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc58961b3f041a085760a4183f3648e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:11.909142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:11.910698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 565/1151] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:11:11 2022] GET /identity/v3/users/dcc58961b3f041a085760a4183f3648e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:11.916622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:11.973168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:12.015992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3958-7e66-4b9e-8663-9dc84a453f17 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:12.048864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad2e7d-9b82-40cf-8a46-248466de121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:12.049502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad2e7d-9b82-40cf-8a46-248466de121d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:12.049782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad2e7d-9b82-40cf-8a46-248466de121d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:12.050054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad2e7d-9b82-40cf-8a46-248466de121d None admin] PATH_INFO: `/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:12.051146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad2e7d-9b82-40cf-8a46-248466de121d None admin] RBAC: Authorizing `identity:get_project(project_id=7ffd0d816ae14d0fac7a4a796ab57c1a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:12.052562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad2e7d-9b82-40cf-8a46-248466de121d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:12.054198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 587/1152] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:11 2022] GET /identity/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:12.060334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:12.114794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:12.159624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c07ae-104c-42a5-8ae9-b3f16b25eba9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:12.191947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdf4fd-745f-44b4-bbeb-5e416d26f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:12.192589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf4fd-745f-44b4-bbeb-5e416d26f694 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:12.192871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf4fd-745f-44b4-bbeb-5e416d26f694 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:12.193177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf4fd-745f-44b4-bbeb-5e416d26f694 None admin] PATH_INFO: `/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a/users/dcc58961b3f041a085760a4183f3648e/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:12.195050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdf4fd-745f-44b4-bbeb-5e416d26f694 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ffd0d816ae14d0fac7a4a796ab57c1a, user_id=dcc58961b3f041a085760a4183f3648e, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:12.197155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdf4fd-745f-44b4-bbeb-5e416d26f694 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:12.209881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 566/1153] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:11:12 2022] PUT /identity/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a/users/dcc58961b3f041a085760a4183f3648e/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:11:14.068400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ef6a-f35a-4998-9df0-94bc0ccd03f2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:14.068937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ef6a-f35a-4998-9df0-94bc0ccd03f2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:14.068937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400ef6a-f35a-4998-9df0-94bc0ccd03f2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:14.070402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 588/1154] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:14.075733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:14.076134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:14.076282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:14.094681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:14.095851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:14.160003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 567/1155] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:14.428925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ef6a-f35a-4998-9df0-94bc0ccd03f2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:14.529905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400ef6a-f35a-4998-9df0-94bc0ccd03f2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:14.552468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:14.563246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:14.563869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:14.564155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:14.564432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:14.574836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:11:14.579651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:14.580733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:11:14.581824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 589/1156] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:14.587532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:14.631469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:14.685926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8169-3790-43d3-933a-5a05c658a714 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:14.718551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:14.719150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:14.719427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:14.719699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:14.720355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:14.720657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:14.722041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:14.729949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 568/1157] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:14.735754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:14.834821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd2d10-48c2-48f1-b14a-5b77f4588858 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:14.869025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:14.869667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:14.869949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:14.870224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] PATH_INFO: `/v3/users/dcc58961b3f041a085760a4183f3648e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:14.871338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc58961b3f041a085760a4183f3648e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:14.872763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:14.874445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 590/1158] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:11:14 2022] GET /identity/v3/users/dcc58961b3f041a085760a4183f3648e => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:14.880314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:14.975940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1ace8-cad2-43e2-9f89-b6724057383b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:14.982499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:15.009203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:15.009796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:15.010069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:15.010334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:15.074110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:15.075543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:15.169073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 569/1159] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:11:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:11:15.175010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:15.228279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:15.275687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b70099-1c16-40f1-be40-e8c4b57fc3a0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:15.308286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011d241-360b-4e82-8fac-d96a985250c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:15.308954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011d241-360b-4e82-8fac-d96a985250c0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:15.309212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011d241-360b-4e82-8fac-d96a985250c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:15.309490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011d241-360b-4e82-8fac-d96a985250c0 None admin] PATH_INFO: `/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:15.310588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011d241-360b-4e82-8fac-d96a985250c0 None admin] RBAC: Authorizing `identity:get_project(project_id=7ffd0d816ae14d0fac7a4a796ab57c1a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:15.312018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011d241-360b-4e82-8fac-d96a985250c0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:15.313662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 591/1160] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:15 2022] GET /identity/v3/projects/7ffd0d816ae14d0fac7a4a796ab57c1a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:15.319765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:15.328537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:15.419913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d777b9-c272-4ff8-868a-191d1df984e1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:15.453679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:15.454274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:15.454553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:15.454826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:15.455544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=7ffd0d816ae14d0fac7a4a796ab57c1a, user.id=dcc58961b3f041a085760a4183f3648e) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:15.455848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:15.457308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320174e7-1e99-4cce-9de9-fe68033f2e83 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:15.462876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 570/1161] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:11:15 2022] GET /identity/v3/role_assignments?user.id=dcc58961b3f041a085760a4183f3648e&scope.project.id=7ffd0d816ae14d0fac7a4a796ab57c1a&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:17.367999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f15742-1da7-4c06-be10-ff0382521b46 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:17.368531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f15742-1da7-4c06-be10-ff0382521b46 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:17.368531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f15742-1da7-4c06-be10-ff0382521b46 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:17.369922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 592/1162] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:17.375146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:17.375526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:17.375703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:17.393524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:17.394704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:17.458762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:17.463774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 571/1163] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:17.730807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f15742-1da7-4c06-be10-ff0382521b46 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:17.829483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f15742-1da7-4c06-be10-ff0382521b46 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:17.848317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:17.862063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:17.862657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:17.862934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:17.863205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:17.927985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:17.929372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:18.024554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 593/1164] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:11:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:11:18.030593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:18.126131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e654062-8881-4700-afdf-c6dec33dc5e2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:18.159447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:18.160056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:18.160333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:18.160604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:18.167285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:18.168711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a8c1e424-1f5c-4548-ac2e-2c41195a8439 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:18.179830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:18.181087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:11:18.182377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 572/1165] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:11:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:18.186752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:18.207749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:18.282716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97e9a-131d-4d7d-9e5a-1fda5683824c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:18.314665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:18.315252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:18.315529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:18.315801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:18.316429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:18.316734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:18.318122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd8e01-dda8-42ee-808d-2b7a402bb24e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:18.325541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 594/1166] 10.222.0.88 () {56 vars in 1115 bytes} [Mon Aug 29 23:11:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:20.201679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3efe-e98a-4987-b041-1550cf01c793 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:20.202212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3efe-e98a-4987-b041-1550cf01c793 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:20.202212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3efe-e98a-4987-b041-1550cf01c793 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:20.203534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 573/1167] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:20.208596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48738bd8-b8de-4d06-9d3d-574f18d283fa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:20.209014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48738bd8-b8de-4d06-9d3d-574f18d283fa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:20.209174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48738bd8-b8de-4d06-9d3d-574f18d283fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:20.228875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-48738bd8-b8de-4d06-9d3d-574f18d283fa None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:20.230096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-48738bd8-b8de-4d06-9d3d-574f18d283fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:20.295660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 595/1168] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:20.568193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3efe-e98a-4987-b041-1550cf01c793 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:20.628406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:20.670635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3efe-e98a-4987-b041-1550cf01c793 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:20.706062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7cd5d-c85d-47d9-9c80-4768709b2450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:20.706661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7cd5d-c85d-47d9-9c80-4768709b2450 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:20.706942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7cd5d-c85d-47d9-9c80-4768709b2450 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:20.707218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7cd5d-c85d-47d9-9c80-4768709b2450 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:20.707876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7cd5d-c85d-47d9-9c80-4768709b2450 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:20.709270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7cd5d-c85d-47d9-9c80-4768709b2450 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:20.725017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 574/1169] 10.222.0.88 () {60 vars in 1138 bytes} [Mon Aug 29 23:11:20 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:11:22.642567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0aafc-65ef-416e-8f62-d13b30b99e8e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:22.643052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0aafc-65ef-416e-8f62-d13b30b99e8e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:22.643143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0aafc-65ef-416e-8f62-d13b30b99e8e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:22.644463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 596/1170] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:22.650022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:22.650430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:22.650584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:22.669297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:22.670474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:22.735785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 575/1171] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:23.004270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0aafc-65ef-416e-8f62-d13b30b99e8e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:23.019888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:23.104539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0aafc-65ef-416e-8f62-d13b30b99e8e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:23.136481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1916e51-bac0-4681-9eed-ff8568837077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:23.137099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916e51-bac0-4681-9eed-ff8568837077 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:23.137403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916e51-bac0-4681-9eed-ff8568837077 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:23.137677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916e51-bac0-4681-9eed-ff8568837077 None admin] PATH_INFO: `/v3/domains/b93e97ffa39e4ecaa9bcc57203470ec7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:23.147667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1916e51-bac0-4681-9eed-ff8568837077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b93e97ffa39e4ecaa9bcc57203470ec7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:23.149847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1916e51-bac0-4681-9eed-ff8568837077 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:23.151417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 597/1172] 10.222.0.88 () {56 vars in 1183 bytes} [Mon Aug 29 23:11:23 2022] GET /identity/v3/domains/b93e97ffa39e4ecaa9bcc57203470ec7 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:23.157580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:23.207585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:23.256910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639ae74-1446-4163-bda4-c52227a409ce None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:23.290232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0d3cd-5608-46f6-9fba-6f5a5831c33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:23.290822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0d3cd-5608-46f6-9fba-6f5a5831c33f None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:23.291099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0d3cd-5608-46f6-9fba-6f5a5831c33f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:23.291371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0d3cd-5608-46f6-9fba-6f5a5831c33f None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:23.292009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0d3cd-5608-46f6-9fba-6f5a5831c33f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:23.293462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0d3cd-5608-46f6-9fba-6f5a5831c33f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:23.318189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 576/1173] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:11:23 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:11:25.222052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f525-11e4-4cb3-aa41-0c17eb149103 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:25.222620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f525-11e4-4cb3-aa41-0c17eb149103 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:25.222620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f525-11e4-4cb3-aa41-0c17eb149103 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:25.223931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 598/1174] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:25.229599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:25.230002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:25.230154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:25.248102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:25.249306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:25.313684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 577/1175] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:25.583885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f525-11e4-4cb3-aa41-0c17eb149103 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:25.659562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:25.685048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f525-11e4-4cb3-aa41-0c17eb149103 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:25.718948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ff19-012a-493a-971f-d5dc99c01e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:25.719564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ff19-012a-493a-971f-d5dc99c01e6f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:25.719846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ff19-012a-493a-971f-d5dc99c01e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:25.720116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ff19-012a-493a-971f-d5dc99c01e6f None admin] PATH_INFO: `/v3/domains/b93e97ffa39e4ecaa9bcc57203470ec7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:25.721218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ff19-012a-493a-971f-d5dc99c01e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=b93e97ffa39e4ecaa9bcc57203470ec7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:25.722633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ff19-012a-493a-971f-d5dc99c01e6f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:25.724177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 599/1176] 10.222.0.88 () {56 vars in 1183 bytes} [Mon Aug 29 23:11:25 2022] GET /identity/v3/domains/b93e97ffa39e4ecaa9bcc57203470ec7 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:25.730002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:25.760014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:25.826225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbda014-d33f-4e36-bc3d-c20ac816fa18 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:25.859396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39d9c-f016-49ce-a9b0-94deecd8da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:25.859935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39d9c-f016-49ce-a9b0-94deecd8da85 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:25.860213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39d9c-f016-49ce-a9b0-94deecd8da85 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:25.860483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39d9c-f016-49ce-a9b0-94deecd8da85 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:25.861139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39d9c-f016-49ce-a9b0-94deecd8da85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:25.862564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39d9c-f016-49ce-a9b0-94deecd8da85 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:25.883102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 578/1177] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:11:25 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:11:27.805824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a529a3d-eabf-4a61-800d-1c1b141618dd None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:27.806375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a529a3d-eabf-4a61-800d-1c1b141618dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:27.806375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a529a3d-eabf-4a61-800d-1c1b141618dd None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:27.807715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 600/1178] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:27.812845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:27.813248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:27.813417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:27.831790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:27.832952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:27.898632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 579/1179] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:28.176124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a529a3d-eabf-4a61-800d-1c1b141618dd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:28.277834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a529a3d-eabf-4a61-800d-1c1b141618dd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:28.311035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:28.311653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:28.311937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:28.312212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:28.322049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:11:28.326857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:28.328018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:11:28.328933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 601/1180] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:28.334107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:28.352998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:28.432836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474cbf-63f6-48cb-a062-32f9090c4be2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:28.465931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:28.466524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:28.466803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:28.467078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:28.467743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:28.468046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:28.469433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:28.478798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 580/1181] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:28.484559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:28.487992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:28.583741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9341c9-0914-44a1-a269-5593387bfabf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:28.617687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:28.618314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:28.618594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:28.618863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] PATH_INFO: `/v3/users/5349873f75884fb68d193112521f6448` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:28.632312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] RBAC: Authorizing `identity:get_user(user_id=5349873f75884fb68d193112521f6448)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:28.634408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:28.636016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 602/1182] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:11:28 2022] GET /identity/v3/users/5349873f75884fb68d193112521f6448 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:28.641912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:28.722131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:28.741049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1de58-541a-4f8b-9c10-b693f99e70c7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:28.774251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:28.774850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:28.775132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:28.775408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:28.840919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:28.842389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:28.917742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:28.936990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 581/1183] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:11:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:11:28.942958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:29.001055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:29.041725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202bf9bb-3078-46db-8b1d-6dcb02483758 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:29.074218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9180c9a-be5d-4c47-9826-8c317e418381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:29.074835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9180c9a-be5d-4c47-9826-8c317e418381 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:29.075118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9180c9a-be5d-4c47-9826-8c317e418381 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:29.075393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9180c9a-be5d-4c47-9826-8c317e418381 None admin] PATH_INFO: `/v3/projects/630cafeeb8ae4597a995144b5cd3690e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:29.076498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9180c9a-be5d-4c47-9826-8c317e418381 None admin] RBAC: Authorizing `identity:get_project(project_id=630cafeeb8ae4597a995144b5cd3690e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:29.077958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9180c9a-be5d-4c47-9826-8c317e418381 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:29.079572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 603/1184] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:28 2022] GET /identity/v3/projects/630cafeeb8ae4597a995144b5cd3690e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:29.086238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:29.182457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add098c-c0ae-4a2f-9102-464d2610aab1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:29.215320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:29.215916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:29.216194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:29.216469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:29.217209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=630cafeeb8ae4597a995144b5cd3690e, user.id=5349873f75884fb68d193112521f6448) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:29.217517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:29.218938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebd70f-938e-4de1-9f86-96d04f0cdd0f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:29.224119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 582/1185] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:11:29 2022] GET /identity/v3/role_assignments?user.id=5349873f75884fb68d193112521f6448&scope.project.id=630cafeeb8ae4597a995144b5cd3690e&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:31.083265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d3ef-4795-4ece-90ef-177af7e88372 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:31.083809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d3ef-4795-4ece-90ef-177af7e88372 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:31.083809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d3ef-4795-4ece-90ef-177af7e88372 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:31.085173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 604/1186] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:31.091059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:31.091472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:31.091604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:31.109800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:31.111139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:31.149840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:31.176010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 583/1187] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:31.442445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d3ef-4795-4ece-90ef-177af7e88372 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:31.545443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d3ef-4795-4ece-90ef-177af7e88372 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:31.572551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:31.580341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:31.580963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:31.581276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:31.581549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:31.592175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:11:31.596968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:31.598105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:11:31.598950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 605/1188] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:31.605309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:31.700460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27291ad4-58ba-473c-8f64-9777eeeab0f6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:31.733522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:31.734122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:31.734401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:31.734678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:31.735344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:31.735641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:31.737001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:31.745045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 584/1189] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:31.750847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:31.853233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40e3ce-7eba-48ba-9c63-c7a93080302f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:31.886381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:31.886996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:31.887275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:31.887549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] PATH_INFO: `/v3/users/5349873f75884fb68d193112521f6448` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:31.888648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] RBAC: Authorizing `identity:get_user(user_id=5349873f75884fb68d193112521f6448)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:31.890110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:31.891704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 606/1190] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:11:31 2022] GET /identity/v3/users/5349873f75884fb68d193112521f6448 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:31.897554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:31.932966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:31.994625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6fdea-d67d-4129-b2eb-91c1ed49df79 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:32.026695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7513cce-ba74-4cb7-aeb8-850cd2ddb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:32.027371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7513cce-ba74-4cb7-aeb8-850cd2ddb341 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:32.027910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7513cce-ba74-4cb7-aeb8-850cd2ddb341 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:32.028259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7513cce-ba74-4cb7-aeb8-850cd2ddb341 None admin] PATH_INFO: `/v3/projects/630cafeeb8ae4597a995144b5cd3690e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:32.029384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7513cce-ba74-4cb7-aeb8-850cd2ddb341 None admin] RBAC: Authorizing `identity:get_project(project_id=630cafeeb8ae4597a995144b5cd3690e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:32.030804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7513cce-ba74-4cb7-aeb8-850cd2ddb341 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:32.032388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 585/1191] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:31 2022] GET /identity/v3/projects/630cafeeb8ae4597a995144b5cd3690e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:32.038359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:32.093694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:32.136704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0b90f-5d69-45b4-bb03-559f2f5f7e83 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:32.170834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e7971-973e-426d-8ea0-94bc071abedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:32.171492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e7971-973e-426d-8ea0-94bc071abedc None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:32.171774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e7971-973e-426d-8ea0-94bc071abedc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:32.172051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e7971-973e-426d-8ea0-94bc071abedc None admin] PATH_INFO: `/v3/projects/630cafeeb8ae4597a995144b5cd3690e/users/5349873f75884fb68d193112521f6448/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:32.173965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e7971-973e-426d-8ea0-94bc071abedc None admin] RBAC: Authorizing `identity:create_grant(project_id=630cafeeb8ae4597a995144b5cd3690e, user_id=5349873f75884fb68d193112521f6448, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:32.175396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e7971-973e-426d-8ea0-94bc071abedc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:32.187708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 607/1192] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:11:32 2022] PUT /identity/v3/projects/630cafeeb8ae4597a995144b5cd3690e/users/5349873f75884fb68d193112521f6448/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:11:34.088347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503e09-678f-4951-94f7-9234019e95e9 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:34.088872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503e09-678f-4951-94f7-9234019e95e9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:34.088872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503e09-678f-4951-94f7-9234019e95e9 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:34.090363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 586/1193] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:11:34.095546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:34.095993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:34.096100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:34.114585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:11:34.115762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:11:34.182741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 608/1194] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:11:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:11:34.450468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503e09-678f-4951-94f7-9234019e95e9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:34.551369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503e09-678f-4951-94f7-9234019e95e9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:34.553649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:34.584979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:34.586355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:34.586669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:34.586942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:34.597554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:11:34.602288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:11:34.603395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:11:34.604364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 587/1195] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:11:34.609414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:34.656241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:34.709521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742884ae-94e2-4545-b2ae-d68eac32eb11 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:34.742180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8136d59-b706-492e-921b-6517993734fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:34.742804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8136d59-b706-492e-921b-6517993734fd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:34.743080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8136d59-b706-492e-921b-6517993734fd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:34.743351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8136d59-b706-492e-921b-6517993734fd None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:34.744012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8136d59-b706-492e-921b-6517993734fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:34.744312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8136d59-b706-492e-921b-6517993734fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:34.745708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8136d59-b706-492e-921b-6517993734fd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:34.753461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 609/1196] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:34.760207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:34.855537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f484c-6932-45f3-a545-efda3cc60ee3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:34.887983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:34.888594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:34.888868 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:34.889158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] PATH_INFO: `/v3/users/5349873f75884fb68d193112521f6448` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:34.890246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] RBAC: Authorizing `identity:get_user(user_id=5349873f75884fb68d193112521f6448)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:34.891722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:34.893275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 588/1197] 10.222.0.88 () {56 vars in 1177 bytes} [Mon Aug 29 23:11:34 2022] GET /identity/v3/users/5349873f75884fb68d193112521f6448 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:34.899261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8136d59-b706-492e-921b-6517993734fd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:34.997465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8136d59-b706-492e-921b-6517993734fd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:35.006084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:35.031659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:35.032255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:35.032536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:35.032807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:35.098566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:35.100006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:35.196702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 610/1198] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:11:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:11:35.202636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:35.233875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:35.301547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdcb8-4a61-4187-99ee-737270a6607c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:35.334060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091ca37-20d5-45e6-95b3-796a7ea18eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:35.334688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091ca37-20d5-45e6-95b3-796a7ea18eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:35.334963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091ca37-20d5-45e6-95b3-796a7ea18eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:35.335235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091ca37-20d5-45e6-95b3-796a7ea18eb2 None admin] PATH_INFO: `/v3/projects/630cafeeb8ae4597a995144b5cd3690e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:35.336432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091ca37-20d5-45e6-95b3-796a7ea18eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=630cafeeb8ae4597a995144b5cd3690e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:35.337883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091ca37-20d5-45e6-95b3-796a7ea18eb2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:35.339485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 589/1199] 10.222.0.88 () {56 vars in 1186 bytes} [Mon Aug 29 23:11:35 2022] GET /identity/v3/projects/630cafeeb8ae4597a995144b5cd3690e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:35.345649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:11:35.356266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:35.442388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe42665-8aa3-4678-93a4-47dfa6c9fa96 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:11:35.474879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:11:35.475471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:11:35.475750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:11:35.476049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:11:35.477301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=630cafeeb8ae4597a995144b5cd3690e, user.id=5349873f75884fb68d193112521f6448) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:11:35.477605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:11:35.479071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe691f-7e44-4186-aaea-1198519f157a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:11:35.484781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 611/1200] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:11:35 2022] GET /identity/v3/role_assignments?user.id=5349873f75884fb68d193112521f6448&scope.project.id=630cafeeb8ae4597a995144b5cd3690e&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:11:45.330000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=50 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:11:45.482270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=64 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:30.782317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73aa7-4f95-4702-b4e9-16a8b5c3f1b8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:30.782886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73aa7-4f95-4702-b4e9-16a8b5c3f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:30.782886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc73aa7-4f95-4702-b4e9-16a8b5c3f1b8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:30.784462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 590/1201] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:30.791079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:30.791600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:30.791691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:30.814033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:30.816145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:30.912008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 612/1202] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:31.198494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73aa7-4f95-4702-b4e9-16a8b5c3f1b8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:31.389729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc73aa7-4f95-4702-b4e9-16a8b5c3f1b8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:31.437313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:31.438138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:31.438458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:31.438760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:31.466856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:31.468892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:31.486366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:31.487638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:31.488835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:31.488835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:31.488835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:31.490291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 591/1203] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:31.496806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:31.629990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450330fd-d4ce-4b1a-98e8-b2146fffd22c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:31.672967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:31.679028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:31.679747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:31.679933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:31.680189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:31.680831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:31.681144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:31.682655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a4b50-cbe4-4736-9484-3bb8bf75c2d4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:31.696140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 613/1204] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:31.702031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:31.765654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:31.820830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c342-3632-49d9-82b2-0e31e7597793 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:31.858523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973dea8-d7ea-44ae-a6fd-2522be9846a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:31.859131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dea8-d7ea-44ae-a6fd-2522be9846a4 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:31.859405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dea8-d7ea-44ae-a6fd-2522be9846a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:31.859674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973dea8-d7ea-44ae-a6fd-2522be9846a4 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:31.860313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973dea8-d7ea-44ae-a6fd-2522be9846a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:31.861775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973dea8-d7ea-44ae-a6fd-2522be9846a4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:31.888206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 592/1205] 10.222.0.88 () {60 vars in 1132 bytes} [Mon Aug 29 23:12:31 2022] POST /identity/v3/users => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:12:34.071781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3c72c-de6d-464b-a97d-209cd9dc79ef None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:34.072356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3c72c-de6d-464b-a97d-209cd9dc79ef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:34.072356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3c72c-de6d-464b-a97d-209cd9dc79ef None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:34.073958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 614/1206] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:34.080248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:34.080673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:34.080797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:34.102110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:34.103630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:34.184345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 593/1207] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:34.473281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3c72c-de6d-464b-a97d-209cd9dc79ef None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:34.590375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3c72c-de6d-464b-a97d-209cd9dc79ef None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:34.630259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:34.633661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:34.633977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:34.634414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:34.646694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:12:34.652561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:34.654092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:12:34.655081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:34.660124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:34.661275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 615/1208] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:34.712094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:34.793312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2c32b-b7b0-48f7-a3e9-2059a43bfd3e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:34.833790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:34.834774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:34.835091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:34.835467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:34.836270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:34.836691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:34.838387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:34.852059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 594/1209] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:34.857755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:34.913558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:34.967666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ddbdbc-a98b-4cb2-9df2-ea44e10a058f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:35.004570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:35.005495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:35.005858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:35.006208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:35.020444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:35.022471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:35.044226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:35.045441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:35.046498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:35.046498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:35.046498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:35.046498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 616/1210] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:35.052109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:35.184992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:35.189421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81be21-bbdd-458e-bd3c-4ff1a0462fe1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:35.231448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:35.232063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:35.232346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:35.232618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:35.233292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:35.233616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:35.234960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:35.248228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 595/1211] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:35.253792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:35.370117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884941-dbd2-49d2-ac70-ad513a68e364 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:35.371846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:35.413671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:35.414786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:35.414786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:35.414987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:35.422542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:35.424012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:12:35.436201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:35.438254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:35.439251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 617/1212] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:35.443206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:35.567047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc71d-d7d3-4dbe-98df-291a82d47dc8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:35.612210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:35.612826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:35.613216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:35.613440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:35.614263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:35.614699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:35.616094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:35.639177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 596/1213] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Aug 29 23:12:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:35.645365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:35.764471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4670dd-5bdd-44f6-8c3b-84c71dff043c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:35.813071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:35.814173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:35.814593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:35.815111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:35.851138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:35.898044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:35.899515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:36.008030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 618/1214] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:12:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:12:36.013612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:36.038636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:36.167353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43f89b-003f-4639-846c-2aa43e2f7a20 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:36.210799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:36.211503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:36.211829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:36.212234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:36.227576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:36.229469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:36.249005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:36.250272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:36.251464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:36.251464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:36.251464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:36.255083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 597/1215] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:36.256795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:36.328684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:36.374399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e5893-d07f-4f84-a386-4935da997116 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:36.415557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:36.416426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:36.416948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:36.417469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:36.418248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:36.418712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:36.420229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:36.438256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 619/1216] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:36.438435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:36.520908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:36.556809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d6db-d95a-4aea-8a36-345f44c319b9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:36.596421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:36.597082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:36.597409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:36.597687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:36.605078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:36.606572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:12:36.620293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:36.621313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:36.622251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:36.626675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 598/1217] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:12:36.628286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:36.754363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41465145-9b45-4f88-b8c6-8e185213a05d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:36.787903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:36.802427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:36.803190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:36.803472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:36.803804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:36.804704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:36.805018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:36.806596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f77a1-4f58-4e86-9268-b23b08780882 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:36.826182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 620/1218] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:12:36.827885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:36.949939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c4f04-d478-4e7e-9222-e0bf5a6ea879 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:36.987161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:36.992501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:36.993342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:36.993628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:36.993902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:36.994656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=7401c08c5de0437f8a605594dcce9395) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:36.995142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:36.996652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbd1bf-2afa-415e-ae2b-6aac7dbd2f10 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:37.003498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 599/1219] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:12:36 2022] GET /identity/v3/role_assignments?user.id=7401c08c5de0437f8a605594dcce9395&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:39.145676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc15-cbcb-446a-a5e3-dc7eabd50eb5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:39.146232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc15-cbcb-446a-a5e3-dc7eabd50eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:39.146232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc15-cbcb-446a-a5e3-dc7eabd50eb5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:39.148294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 621/1220] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:39.155088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:39.155573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:39.155674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:39.174483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:39.175649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:39.246028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 600/1221] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:39.549198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc15-cbcb-446a-a5e3-dc7eabd50eb5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:39.663550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc15-cbcb-446a-a5e3-dc7eabd50eb5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:39.698253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:39.698884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:39.699174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:39.699451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:39.711575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:12:39.717618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:39.718772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:39.719991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 622/1222] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:12:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:39.726506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:39.831462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1283-44d2-4029-bf00-6ca0d740fa87 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:39.856203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:39.867967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:39.868575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:39.868848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:39.869127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:39.869816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:39.870109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:39.871472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:39.880267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 601/1223] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:12:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:39.886115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:39.936398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:40.005557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac125a-10d8-42ca-b59c-8bafc3b4e346 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:40.051208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:40.051840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:40.052117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:40.052462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:40.063639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:40.065079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:40.080217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:40.082776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:40.083909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:40.083909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:40.083909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:40.083909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 623/1224] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:40.088024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:40.196703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83978bc4-7fdd-493c-8752-7d96264fed6d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:40.240509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:40.241138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:40.241433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:40.241710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:40.242351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:40.242654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:40.244024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:40.259661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 602/1225] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:40.265641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:40.376033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:40.387240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466b03d-c12c-496d-a502-e417d26542dc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:40.426882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:40.427534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:40.427837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:40.428194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:40.436576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:40.438061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:12:40.449906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:40.451408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:40.452352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 624/1226] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:40.457093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:40.508303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:40.571304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7a72f-8796-4464-b564-13bbc6f9b4a5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:40.609658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:40.610356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:40.610734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:40.611009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:40.611734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:40.612139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:40.613907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:40.635821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 603/1227] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Aug 29 23:12:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:40.641682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:40.757959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077c588-46a9-4a64-8608-53920db461fd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:40.797433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:40.798076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:40.798336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:40.798614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:40.809787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:40.811239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:40.828649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:40.830000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:40.831104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:40.831104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:40.831104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:40.831104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 625/1228] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:40.836849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:40.939466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453937d-270f-4e7d-ab30-a77fc3a1b4a7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:40.941791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:40.978613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:40.979224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:40.979502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:40.979772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:40.980407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:40.980708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:40.982171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:40.995877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 604/1229] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:41.002022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:41.013551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:41.118818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aefa9d-3f5f-4690-ba7f-dc6d8713a1ea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:41.158283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:41.158917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:41.159205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:41.159476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:41.166823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:41.168273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:12:41.180730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:41.181930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:41.183236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 626/1230] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:41.190513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:41.300701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d88b4-3c1f-454b-bb43-e1759dcd1637 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:41.337782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:41.338386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:41.338669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:41.338947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:41.339791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:41.340102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:41.341582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370ad8-87f3-4eef-a55a-35280eebc510 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:41.356779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 605/1231] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:41.362789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:41.433494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:41.470641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1dc8-0a0b-45fc-8f56-3c24ef4a0344 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:41.507252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637acd-3324-496a-99f1-237d981ca019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:41.507914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637acd-3324-496a-99f1-237d981ca019 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:41.508224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637acd-3324-496a-99f1-237d981ca019 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:41.508527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637acd-3324-496a-99f1-237d981ca019 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/7401c08c5de0437f8a605594dcce9395/roles/b711634981a34fdb9c0745819fa3ae28` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:41.524600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637acd-3324-496a-99f1-237d981ca019 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=7401c08c5de0437f8a605594dcce9395, role_id=b711634981a34fdb9c0745819fa3ae28)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:41.526172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637acd-3324-496a-99f1-237d981ca019 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:41.539902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 627/1232] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:12:41 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/7401c08c5de0437f8a605594dcce9395/roles/b711634981a34fdb9c0745819fa3ae28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:12:43.462535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714f6d-6f8a-478e-8194-cf2f86e1aec3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:43.463080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714f6d-6f8a-478e-8194-cf2f86e1aec3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:43.463080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714f6d-6f8a-478e-8194-cf2f86e1aec3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:43.464415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 606/1233] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:43.469570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:43.469951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:43.470131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:43.489245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:43.490496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:43.561469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 628/1234] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:43.844606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46714f6d-6f8a-478e-8194-cf2f86e1aec3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:43.872221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:43.956558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46714f6d-6f8a-478e-8194-cf2f86e1aec3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:43.994156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:43.994784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:43.995058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:43.995323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:44.005331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:12:44.010579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:44.017070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:44.018225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 607/1235] 10.222.0.88 () {56 vars in 1102 bytes} [Mon Aug 29 23:12:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:44.018985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:44.070468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:44.135560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a34030-34e6-4978-983d-4aef0dec471e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:44.172253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:44.173437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:44.173437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:44.173637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:44.174352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:44.174723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:44.176483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:44.184831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 629/1236] 10.222.0.88 () {56 vars in 1103 bytes} [Mon Aug 29 23:12:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:12:44.191032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:44.287315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:44.310609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a14ad2-3c4b-41aa-ab05-c833653b3394 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:44.351422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:44.352117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:44.352391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:44.352657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:44.363662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:44.365273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:44.382031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:44.383201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:44.384401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:44.384401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:44.384401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:44.384401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 608/1237] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:44.389299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:44.539041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed81a1-b50e-445e-9fbb-3cdd6dbae4b8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:44.550041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:44.578222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:44.578871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:44.579198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:44.579468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:44.580106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:44.580402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:44.581799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:44.601144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 630/1238] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:44.606779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:44.717943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c833-78bb-4b70-bcd5-7ec1838e22a0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:44.757766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:44.758420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:44.758697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:44.759040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:44.762161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:44.768763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:44.770811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:12:44.784320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:44.785500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:44.786703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 609/1239] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:44.792629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:44.899325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d763d43-7ce4-43c6-9f93-d0f0edfb6786 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:44.937274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:44.937883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:44.938162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:44.938434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:44.939283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:44.939652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:44.941222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:44.961661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 631/1240] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Aug 29 23:12:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:44.967615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:45.088334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5771940-587a-40d9-8c91-ad7bc7edc028 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:45.128330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:45.128940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:45.129259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:45.129557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:45.199020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:45.208525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:45.210087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:45.317405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 610/1241] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:12:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:12:45.323584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:45.352707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:45.429774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793b760-f886-45cd-84d4-fb40f4562d0d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:45.465163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:45.465795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:45.466076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:45.466351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:45.476786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:45.478312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:45.495162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:45.496402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:45.497512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:45.497512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:45.497512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:45.497512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 632/1242] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:45.502074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:45.608723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:45.614982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2ef37-6589-4008-b50f-966aaed91ea8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:45.650609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:45.651214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:45.651486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:45.651755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:45.652388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:45.652685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:45.654338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:45.666464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 611/1243] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:12:45.671975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:45.754363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:45.776406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c545054-1d00-4c04-b2dd-40ecf0c748d1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:45.811394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:45.812028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:45.812301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:45.812571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:45.819371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:45.820836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:12:45.832259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:45.833397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:45.834823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 633/1244] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:45.839340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:45.948224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506faaa6-e5ef-4553-b1b4-63a8d69481e4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:45.985582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:45.986193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:45.986470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:45.986737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:45.987419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:45.987718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:45.989154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c313bbd-22ae-4ca4-8b16-7c9712a28e59 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:46.001647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 612/1245] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:46.008542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:46.134603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2a99-6f56-4afa-8c52-c2f2e0939600 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:46.172755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:46.173390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:46.173691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:46.173948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:46.174680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] RBAC: Adding query filter params (role.id=b711634981a34fdb9c0745819fa3ae28, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=7401c08c5de0437f8a605594dcce9395) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:46.175005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:46.176420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f9761-7ab2-41a5-b979-4b15a3e0da9a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:46.183501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 634/1246] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:12:46 2022] GET /identity/v3/role_assignments?user.id=7401c08c5de0437f8a605594dcce9395&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=b711634981a34fdb9c0745819fa3ae28 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:48.217927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0808b-b03a-411e-aabe-73a1f3a2c1eb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:48.218481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0808b-b03a-411e-aabe-73a1f3a2c1eb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:48.218481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0808b-b03a-411e-aabe-73a1f3a2c1eb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:48.219951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 613/1247] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:48.226156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:48.226575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:48.226706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:48.232961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:48.247990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:48.249223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:48.331525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 635/1248] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:48.617096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0808b-b03a-411e-aabe-73a1f3a2c1eb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:48.639685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:48.745964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0808b-b03a-411e-aabe-73a1f3a2c1eb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:48.789707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:48.790356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:48.790628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:48.790904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:48.802919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:12:48.807716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:48.808723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:48.809612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 614/1249] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:12:48.815001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:48.928303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973c30-32fb-40ab-801b-e7848bd65068 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:48.959360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:48.964800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:48.965445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:48.965732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:48.966003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:48.966688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:48.966967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:48.968376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:48.977237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 636/1250] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:12:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:48.983098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:49.077049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:49.104399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb079-03a1-4aa3-8c52-0cc99ae550b3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:49.147983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:49.148615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:49.148891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:49.149189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:49.160535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:49.162552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:49.179555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:49.180933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:49.182117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:49.182117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:49.182117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:49.182117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 615/1251] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:49.187063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:49.298553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e734711-d3bf-4396-9db7-7314e1dbd201 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:49.338757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:49.339365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:49.339648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:49.339924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:49.340566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:49.340871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:49.342454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:49.355116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 637/1252] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:49.360948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:49.476113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f396a11-7824-484a-b973-c3e09de89b80 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:49.507511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:49.515630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:49.516272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:49.516556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:49.516833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:49.525539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:49.527048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:12:49.539587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:49.546237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:49.547435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 616/1253] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:49.548379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:49.611616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:49.661933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96074-781b-4f8b-81e3-61677f1d3d99 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:49.698647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:49.699285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:49.699579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:49.699860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:49.700668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:49.700979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:49.702450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:49.720857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 638/1254] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Aug 29 23:12:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:49.727824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:49.837071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4bdb6-4c87-4c09-9c3c-a467d322bf02 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:49.870504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:49.871108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:49.871385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:49.871659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:49.928912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:49.942603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:49.944257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:50.060578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 617/1255] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:12:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:12:50.066852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:50.173315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5308-76a7-4ced-a35c-a34d009934cf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:50.187210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:50.210600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:50.211235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:50.211532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:50.211795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:50.222764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:50.224317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:50.239874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:50.241028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:50.242127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:50.242127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:50.242127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:50.242127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 639/1256] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:50.246939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:50.345584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:50.358947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72dc1d-2187-42a1-87a9-e8fdf7869b6a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:50.398624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:50.399275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:50.399496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:50.399764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:50.400398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:50.400697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:50.402104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:50.413648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 618/1257] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:50.419680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:50.528278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9b8e-4a0a-495e-ab25-cad6459aacfa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:50.567883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:50.569275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:50.569698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:50.570033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:50.577772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:50.579426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:12:50.592829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:50.594030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:50.595125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 640/1258] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:50.600058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:50.713319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba799e23-142e-452c-9080-2efcffe9498d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:50.752743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:50.753378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:50.753669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:50.753925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:50.754615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:50.754919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:50.757053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1eaa-6a36-4b47-86b0-d7fad7184c65 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:50.771748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 619/1259] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:50.777882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:50.810542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:50.900451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f30c3-01b5-4d29-bdf0-d8bc09606f9c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:50.936888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:50.937580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:50.937824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:50.938073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:50.938831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=7401c08c5de0437f8a605594dcce9395) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:50.939131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:50.940564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0583700-1db3-4e12-abb4-0a4d223e1879 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:50.946449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 641/1260] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:12:50 2022] GET /identity/v3/role_assignments?user.id=7401c08c5de0437f8a605594dcce9395&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:52.846033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006d090-5897-4700-84d6-58ec102a18bc None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:52.846554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006d090-5897-4700-84d6-58ec102a18bc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:52.846554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006d090-5897-4700-84d6-58ec102a18bc None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:52.847895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 620/1261] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:52.853716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:52.854154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:52.854273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:52.872332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:52.873473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:52.939409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 642/1262] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:53.208332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006d090-5897-4700-84d6-58ec102a18bc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:53.219632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:53.306705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006d090-5897-4700-84d6-58ec102a18bc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:53.340134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:53.340743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:53.341019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:53.341312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:53.350976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:12:53.355732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:53.356841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:53.357905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 621/1263] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:53.362914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:53.382535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:53.470619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a782c1-63db-4d00-9ea4-0c11bcfffc91 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:53.503316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:53.503917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:53.504200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:53.504479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:53.505165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:53.505473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:53.507520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:53.515287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 643/1264] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:53.521047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:53.586914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:53.620984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641939e-a2bb-4d7f-89da-a5c68d254d57 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:53.654365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:53.654987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:53.655269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:53.655543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:53.665889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:53.667399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:53.681891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:53.683009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:53.684281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:53.684281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:53.684281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:53.684281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 622/1265] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:53.688890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:53.775534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:53.797558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a92ad-0430-44d9-84e9-ba4f375880ca None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:53.830231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:53.830831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:53.831116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:53.831394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:53.832030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:53.832334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:53.833739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:53.845193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 644/1266] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:53.851465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:53.949254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd792c-de81-4161-94f2-fce217fbdb4e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:53.968171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:53.982927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:53.983541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:53.983821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:53.984094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] PATH_INFO: `/v3/users/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:53.991963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:53.993421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:12:54.004251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:54.005440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:54.006822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 623/1267] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:54.011761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:54.119451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f49176-b484-4970-9f4d-cd71be2261a7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:54.152931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:54.153558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:54.153842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:54.154376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:54.155094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:54.155396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:54.156818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.165879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:54.174298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 645/1268] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Aug 29 23:12:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:54.180072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:54.277431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f92a6-8fe1-4168-b8e1-3fc1e95ca7de None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:54.309949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:54.310565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:54.310843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:54.311116 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:54.321227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:54.322665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:54.336814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:54.337952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:54.338869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:54.338869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:54.338869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:54.338869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 624/1269] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:54.343691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:54.438763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145adff7-6fc2-4dc3-8171-854197eb34ad None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:54.473208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:54.473803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:54.474083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:54.474356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:54.475687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:54.476143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:54.477809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.488833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 646/1270] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:54.494702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:54.526840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:54.603727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a5872-0197-4544-bd56-43b5eb6a84b8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:54.637027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:54.637691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:54.637969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:54.638242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:54.644704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:54.646183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:12:54.658798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:54.659864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:54.661098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 625/1271] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:12:54.665790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:54.723824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:54.765906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77b34c-0198-45ba-b00d-b5e8925fcb4e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:54.799190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:54.799792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:54.800073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:54.800440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:54.801202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:54.801512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:54.803062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fdb45-b783-4fb7-83d5-11e8feefb3e7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.816122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 647/1272] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:54.822744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:54.910860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:54.919935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05502bab-7790-4932-b687-bc8d7c5d7ac9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:54.952671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3737a2-b67c-489a-8705-eac9b27c3e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:54.953338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3737a2-b67c-489a-8705-eac9b27c3e36 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:54.953615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3737a2-b67c-489a-8705-eac9b27c3e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:54.953886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3737a2-b67c-489a-8705-eac9b27c3e36 None admin] PATH_INFO: `/v3/projects/4baa30612c2847c997568c8533a3a554/users/7401c08c5de0437f8a605594dcce9395/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:54.955704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3737a2-b67c-489a-8705-eac9b27c3e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=4baa30612c2847c997568c8533a3a554, user_id=7401c08c5de0437f8a605594dcce9395, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:54.957191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3737a2-b67c-489a-8705-eac9b27c3e36 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:54.969159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 626/1273] 10.222.0.88 () {58 vars in 1439 bytes} [Mon Aug 29 23:12:54 2022] PUT /identity/v3/projects/4baa30612c2847c997568c8533a3a554/users/7401c08c5de0437f8a605594dcce9395/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:12:56.865703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafdbc-d024-4c7e-951b-94e6d00c4cd2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:56.866290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafdbc-d024-4c7e-951b-94e6d00c4cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:56.866290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafdbc-d024-4c7e-951b-94e6d00c4cd2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:56.867580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 648/1274] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:12:56.872760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:56.873222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:56.873322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:56.891916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:12:56.893102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:12:56.958428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 627/1275] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:12:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:12:57.243764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafdbc-d024-4c7e-951b-94e6d00c4cd2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:57.343065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafdbc-d024-4c7e-951b-94e6d00c4cd2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:57.360397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:57.376947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:57.377601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:57.377886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:57.378162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:57.388028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:12:57.392851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:57.394050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:57.395013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 649/1276] 10.222.0.88 () {56 vars in 1096 bytes} [Mon Aug 29 23:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:12:57.400483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:57.480320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:57.498590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23958298-1088-4f0c-9369-907ad5f42e54 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:57.532117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:57.532712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:57.532988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:57.533291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:57.533948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:57.534249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:57.535605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:57.543582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 628/1277] 10.222.0.88 () {56 vars in 1099 bytes} [Mon Aug 29 23:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:57.549244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:57.647950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5315c27-eb4f-41b6-acb6-a6416d6393ee None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:57.682692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:57.683480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:57.683762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:57.684033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:57.694325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:57.695959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:57.711406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:57.712541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:57.713662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:57.713662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:57.713662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:57.713662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 650/1278] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:57.718557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:57.815490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc49a4b-e529-4a66-b49b-63a5a160d281 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:57.848810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:57.849437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:57.849748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:57.850200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:57.850844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:57.851152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:57.852507 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:57.863757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 629/1279] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:57.870211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:57.900095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:57.966388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c0b6-ba22-413b-aed6-a737ddd6885e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:57.998241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:57.998845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:57.999120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:57.999390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:58.007368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:58.008887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:12:58.021437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:58.023713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:12:58.024911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 651/1280] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:58.029588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:58.033717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:58.127960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8ac9a-9e8a-4fd2-8209-74b07bb45e72 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:58.160777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:58.161391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:58.161669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:58.161938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:58.163339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:58.163637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:58.165049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:58.182323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 630/1281] 10.222.0.88 () {56 vars in 1143 bytes} [Mon Aug 29 23:12:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:58.188029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:58.275085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:58.285087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731133a0-0c66-425c-aaa1-4674d59897e5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:58.317997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:58.318630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:58.318996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:58.319270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:58.382823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:58.384190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:58.470202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:58.481015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 652/1282] 10.222.0.88 () {58 vars in 1282 bytes} [Mon Aug 29 23:12:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:12:58.486858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:58.545877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:58.586925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3c305-38b2-4acf-abe1-e64c1b3cbb5c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:58.620295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:58.620915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:58.621213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:58.621485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:58.631251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:58.633310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:12:58.647253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:58.648227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:12:58.649260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:12:58.649260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:12:58.649260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:58.649260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 631/1283] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:58.654003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:58.750589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b13dd5-9296-4fe6-985f-981f054dec4d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:58.784346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:58.784948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:58.785268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:58.785545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:58.786183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:58.786486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:58.787859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:58.798899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 653/1284] 10.222.0.88 () {56 vars in 1109 bytes} [Mon Aug 29 23:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:58.805552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:58.901060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd124b15-2414-4e8c-bb5c-f5f5014c0607 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:58.914784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:58.934209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:58.934817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:58.935092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:58.935358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:58.941687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:58.943105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:12:58.954039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:12:58.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Aug 29 23:12:58.955853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 632/1285] 10.222.0.88 () {56 vars in 1111 bytes} [Mon Aug 29 23:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:12:58.961908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:59.014169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:12:59.067957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195545e-bade-468f-bde8-f92865dbb9c2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:59.099530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:59.100622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:59.100899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:59.101196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:59.101877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:59.102175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:59.103592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962b46b-ab52-4542-a2f6-39e3af785ae0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:59.115095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 654/1286] 10.222.0.88 () {56 vars in 1148 bytes} [Mon Aug 29 23:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:12:59.121742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:12:59.219372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959d7f-ca85-4dc8-8079-378ce704b609 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:12:59.252453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:12:59.253045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:12:59.253351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:12:59.253626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:12:59.254342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] RBAC: Adding query filter params (role.id=eb15617c2b2f4990900925ac0a1e8bfc, scope.project.id=4baa30612c2847c997568c8533a3a554, user.id=7401c08c5de0437f8a605594dcce9395) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:12:59.254646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:12:59.256095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a670ff-a765-4910-b6e2-db41cd96b5de None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:12:59.262687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 633/1287] 10.222.0.88 () {56 vars in 1374 bytes} [Mon Aug 29 23:12:59 2022] GET /identity/v3/role_assignments?user.id=7401c08c5de0437f8a605594dcce9395&scope.project.id=4baa30612c2847c997568c8533a3a554&role.id=eb15617c2b2f4990900925ac0a1e8bfc => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:13:01.171698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60bb6-5f3e-4db8-940f-c81495d99bc0 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:01.172262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60bb6-5f3e-4db8-940f-c81495d99bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:01.172262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60bb6-5f3e-4db8-940f-c81495d99bc0 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:01.173626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 655/1288] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:13:01.178715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:01.179112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:01.179270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:01.197421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:13:01.198609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:01.228102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:01.264766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 634/1289] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:13:01.533348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60bb6-5f3e-4db8-940f-c81495d99bc0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:01.632327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60bb6-5f3e-4db8-940f-c81495d99bc0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:01.642741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:01.665965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:01.666661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:01.666938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:01.667210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:01.667787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:01.669176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:13:01.677727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:13:01.679626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:01.680586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 656/1290] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:13:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:13:01.685325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:01.780660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464a377-3a2a-43a2-b87a-961bab79abd1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:01.814290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:01.814821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:01.815097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:01.815369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:01.815985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:13:01.816287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:01.817677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b1875-9800-4ed9-867f-1c579f7db79c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:01.823081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 635/1291] 10.222.0.88 () {56 vars in 1116 bytes} [Mon Aug 29 23:13:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:13:01.828741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:01.926167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e952e4c-cad0-4d7e-8742-0ed53258c997 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:01.957958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:01.958548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:01.958829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:01.959635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:01.960357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] RBAC: Adding query filter params (type=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:13:01.960661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:01.962057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f061c-c735-4f68-b87f-b882a6bb58df None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:01.966315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 657/1292] 10.222.0.88 () {56 vars in 1116 bytes} [Mon Aug 29 23:13:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:13:03.891895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240fda0-3616-444a-993f-4cdc0120a54d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:03.892396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240fda0-3616-444a-993f-4cdc0120a54d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:03.892396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240fda0-3616-444a-993f-4cdc0120a54d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:03.893743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 636/1293] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:13:03.898847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15d6d-3954-4048-bc71-ce3270962845 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:03.899348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15d6d-3954-4048-bc71-ce3270962845 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:03.899444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15d6d-3954-4048-bc71-ce3270962845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:03.917279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5ad15d6d-3954-4048-bc71-ce3270962845 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:13:03.918455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5ad15d6d-3954-4048-bc71-ce3270962845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:03.948564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:03.985544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 658/1294] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:13:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:13:04.264746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240fda0-3616-444a-993f-4cdc0120a54d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:04.296902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:04.367767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240fda0-3616-444a-993f-4cdc0120a54d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:04.400797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e4949-2bd7-42ac-86c6-441f1f167548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:04.401426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e4949-2bd7-42ac-86c6-441f1f167548 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:04.401707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e4949-2bd7-42ac-86c6-441f1f167548 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:04.401981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e4949-2bd7-42ac-86c6-441f1f167548 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:04.402620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e4949-2bd7-42ac-86c6-441f1f167548 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:04.403980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e4949-2bd7-42ac-86c6-441f1f167548 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:04.418861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 637/1295] 10.222.0.88 () {60 vars in 1141 bytes} [Mon Aug 29 23:13:04 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:13:06.313842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f3330-9367-4041-b3a3-d728de4b102f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:06.314395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f3330-9367-4041-b3a3-d728de4b102f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:06.314395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f3330-9367-4041-b3a3-d728de4b102f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:06.315729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 659/1296] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:13:06.320825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:06.321278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:06.321411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:06.339773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:13:06.340954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:06.411549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 638/1297] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:13:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:13:06.699937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f3330-9367-4041-b3a3-d728de4b102f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:06.799166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f3330-9367-4041-b3a3-d728de4b102f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:06.834811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:06.835439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:06.835721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:06.835997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:06.836579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:06.837984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:13:06.846586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:13:06.847747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:06.848801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 660/1298] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:13:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:13:06.854448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:06.873950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:06.953035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef33ab-416f-4131-8c43-d9d496c3509d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:06.986723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:06.987331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:06.987611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:06.987885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:06.988509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:13:06.988808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:06.990899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:06.995896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 639/1299] 10.222.0.88 () {56 vars in 1116 bytes} [Mon Aug 29 23:13:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:13:07.001809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:07.037579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:07.105633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43bc28-6709-4430-8522-c7fb7936866e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:07.138915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:07.139444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:07.139723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:07.139994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:07.140683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] RBAC: Adding query filter params (interface=public, service_id=ec999b8dbe104b53a8043d7202391db1, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:13:07.140993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:07.142374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d47e3-4144-4143-8c3f-da30ebb65ea5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:07.147390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 661/1300] 10.222.0.88 () {56 vars in 1251 bytes} [Mon Aug 29 23:13:07 2022] GET /identity/v3/endpoints?service_id=ec999b8dbe104b53a8043d7202391db1&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:13:07.153049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:07.234884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:07.252683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7b2b0-d90b-42da-96c9-b85429ca4e9c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:07.287738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e730-200f-46e1-8a53-fd55565f0e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:07.288338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e730-200f-46e1-8a53-fd55565f0e41 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:07.288617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e730-200f-46e1-8a53-fd55565f0e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:07.288889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e730-200f-46e1-8a53-fd55565f0e41 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:07.289517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e730-200f-46e1-8a53-fd55565f0e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:07.290887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e730-200f-46e1-8a53-fd55565f0e41 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:07.297606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 640/1301] 10.222.0.88 () {56 vars in 1087 bytes} [Mon Aug 29 23:13:07 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:13:09.259417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692df86-a3db-44cc-b212-9db48f459f38 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:09.259975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692df86-a3db-44cc-b212-9db48f459f38 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:09.259975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692df86-a3db-44cc-b212-9db48f459f38 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:09.261317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 662/1302] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:13:09.266471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:09.266882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:09.267025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:09.287039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:13:09.288817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:13:09.356985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 641/1303] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:13:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:13:09.641454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692df86-a3db-44cc-b212-9db48f459f38 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:09.734607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:09.742243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692df86-a3db-44cc-b212-9db48f459f38 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:09.774629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:09.775245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:09.775525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:09.775797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:09.776367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:09.777758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:13:09.786612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:13:09.794111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Aug 29 23:13:09.795189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 663/1304] 10.222.0.88 () {56 vars in 1117 bytes} [Mon Aug 29 23:13:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:13:09.796193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:09.874719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:09.898978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33076c97-7382-41c6-b220-c3d318e97a32 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:09.933129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:09.933739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:09.934022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:09.934296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:09.934921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:13:09.935222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:09.936579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a640baa-a455-4495-9e15-2025e726a77e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:09.941718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 642/1305] 10.222.0.88 () {56 vars in 1116 bytes} [Mon Aug 29 23:13:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:13:09.947648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:13:10.049615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97666469-ed58-4dc1-937d-8c2674595c32 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:13:10.085920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391188-f382-45ca-a04e-5454773e8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:13:10.086518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391188-f382-45ca-a04e-5454773e8d07 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:13:10.086801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391188-f382-45ca-a04e-5454773e8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:13:10.087077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391188-f382-45ca-a04e-5454773e8d07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:13:10.087751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391188-f382-45ca-a04e-5454773e8d07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:13:10.089143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391188-f382-45ca-a04e-5454773e8d07 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:13:10.107950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 664/1306] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:13:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:13:19.938686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=30 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:13:20.103668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:14.417307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369507a9-da81-4244-9e13-d25d19f98c7b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:14.417874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369507a9-da81-4244-9e13-d25d19f98c7b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:14.417874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369507a9-da81-4244-9e13-d25d19f98c7b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:14.423275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 643/1307] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:14.424433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5b90c-ee6a-4f58-993a-334e88e3e2fe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:14.424878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5b90c-ee6a-4f58-993a-334e88e3e2fe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:14.424973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5b90c-ee6a-4f58-993a-334e88e3e2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:14.537002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a1b5b90c-ee6a-4f58-993a-334e88e3e2fe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:14.541637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a1b5b90c-ee6a-4f58-993a-334e88e3e2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:14.773706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 665/1308] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:14:15.077491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34ea5e-6e3c-4cdf-8603-ca6f3b723b0f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:15.077764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34ea5e-6e3c-4cdf-8603-ca6f3b723b0f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:15.078034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34ea5e-6e3c-4cdf-8603-ca6f3b723b0f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:15.079552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 644/1309] 10.222.0.88 () {54 vars in 965 bytes} [Mon Aug 29 23:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:15.086369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429f3f-2809-413e-9353-9713be5d3539 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:15.086657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429f3f-2809-413e-9353-9713be5d3539 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:15.086941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429f3f-2809-413e-9353-9713be5d3539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:15.175815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ec429f3f-2809-413e-9353-9713be5d3539 None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:15.178386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec429f3f-2809-413e-9353-9713be5d3539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:15.201176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:15.261589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 666/1310] 10.222.0.88 () {58 vars in 1062 bytes} [Mon Aug 29 23:14:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:15.271400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34ea5e-6e3c-4cdf-8603-ca6f3b723b0f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:15.273153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7c34ea5e-6e3c-4cdf-8603-ca6f3b723b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:15.399528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34ea5e-6e3c-4cdf-8603-ca6f3b723b0f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:15.492685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:15.494015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:15.494621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:15.495050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:15.496800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:15.555654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:15.618998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:15.620731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cdaea-4e7b-49fd-b81c-4b4d6b313633 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:15.641839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 645/1311] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:17.901764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc8fb5-c6a6-4ba6-9b60-3459bee6c2e2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:17.902224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc8fb5-c6a6-4ba6-9b60-3459bee6c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:17.902317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc8fb5-c6a6-4ba6-9b60-3459bee6c2e2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:17.903693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 667/1312] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:17.909990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb5ef-f1df-4650-a434-95ebd31e32b2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:17.910374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb5ef-f1df-4650-a434-95ebd31e32b2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:17.910553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb5ef-f1df-4650-a434-95ebd31e32b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:17.993871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-47ebb5ef-f1df-4650-a434-95ebd31e32b2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:17.995066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-47ebb5ef-f1df-4650-a434-95ebd31e32b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:18.092235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 646/1313] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:18.376403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc8fb5-c6a6-4ba6-9b60-3459bee6c2e2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:18.377959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bafc8fb5-c6a6-4ba6-9b60-3459bee6c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:18.479906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc8fb5-c6a6-4ba6-9b60-3459bee6c2e2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:18.550494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:18.553708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:18.554482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:18.555088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:18.555560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:18.557198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:18.664816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:18.666292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205d375-7a66-42b9-9a53-949ac7f4ea10 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:18.684554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 668/1314] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:20.887572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5eb9-9814-4f12-8ce0-30ec0b6799ff None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:20.888101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5eb9-9814-4f12-8ce0-30ec0b6799ff None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:20.888101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e5eb9-9814-4f12-8ce0-30ec0b6799ff None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:20.889409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 647/1315] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:20.894641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4b3c-c6d7-48a7-9f4b-cf9322539fef None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:20.895096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4b3c-c6d7-48a7-9f4b-cf9322539fef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:20.895290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4b3c-c6d7-48a7-9f4b-cf9322539fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:20.962524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-006d4b3c-c6d7-48a7-9f4b-cf9322539fef None None] MFA Rules not processed for user `8fb4793c3a0843b1ab85af535af499d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:20.963727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-006d4b3c-c6d7-48a7-9f4b-cf9322539fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:21.014118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:21.062060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 669/1316] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:21.346862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5eb9-9814-4f12-8ce0-30ec0b6799ff None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:21.348989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-314e5eb9-9814-4f12-8ce0-30ec0b6799ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:21.358765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:21.449987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e5eb9-9814-4f12-8ce0-30ec0b6799ff None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:21.522891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:21.523497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:21.523779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:21.524059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:21.525681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:21.588043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:21.634693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:21.636158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf308564-d65b-4430-9d2b-36e0b67981c6 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:21.654143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 648/1317] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:24.113253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939082c8-078d-4a70-9a3f-13bdc48e9bfd None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:24.113781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939082c8-078d-4a70-9a3f-13bdc48e9bfd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:24.114055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939082c8-078d-4a70-9a3f-13bdc48e9bfd None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:24.115421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 670/1318] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:24.120622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937faec6-51d6-4fa1-affb-3ecbfdbffb99 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:24.121035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937faec6-51d6-4fa1-affb-3ecbfdbffb99 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:24.121208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937faec6-51d6-4fa1-affb-3ecbfdbffb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:24.186952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-937faec6-51d6-4fa1-affb-3ecbfdbffb99 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:24.188103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-937faec6-51d6-4fa1-affb-3ecbfdbffb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:24.285027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 649/1319] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:24.573323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939082c8-078d-4a70-9a3f-13bdc48e9bfd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:24.574844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-939082c8-078d-4a70-9a3f-13bdc48e9bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:24.678689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939082c8-078d-4a70-9a3f-13bdc48e9bfd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:24.749494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:24.750094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:24.750368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:24.750637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:24.752204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:24.759625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:24.859818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:24.861197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef565ec9-82a1-4cc8-a823-c8799dbf3ac3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:24.880089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 671/1320] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:27.447753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c1e13-4f75-4596-8422-e830b63b2c7e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:27.448292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c1e13-4f75-4596-8422-e830b63b2c7e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:27.448292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c1e13-4f75-4596-8422-e830b63b2c7e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:27.449681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 650/1321] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:27.454833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb70b-0e1e-49c6-9bb2-df4b27708eff None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:27.455212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb70b-0e1e-49c6-9bb2-df4b27708eff None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:27.455406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb70b-0e1e-49c6-9bb2-df4b27708eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:27.532545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-432bb70b-0e1e-49c6-9bb2-df4b27708eff None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:27.533796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-432bb70b-0e1e-49c6-9bb2-df4b27708eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:27.594099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:27.646522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 672/1322] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:27.937638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c1e13-4f75-4596-8422-e830b63b2c7e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:27.939251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c51c1e13-4f75-4596-8422-e830b63b2c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:27.959374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:28.045351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c1e13-4f75-4596-8422-e830b63b2c7e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:28.118804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:28.119460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:28.119688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:28.119957 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:28.121587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:28.194074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:28.235716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:28.237192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bf8c3-f12c-468e-b4d9-6c61be79b996 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:28.256482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 651/1323] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:30.262601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da388b1-f214-47fd-a23c-2a75a1cf1a39 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:30.263123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da388b1-f214-47fd-a23c-2a75a1cf1a39 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:30.263123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da388b1-f214-47fd-a23c-2a75a1cf1a39 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:30.264741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 673/1324] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:30.270666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1960-20d2-476a-a98b-79c1dc135aa6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:30.271095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1960-20d2-476a-a98b-79c1dc135aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:30.271203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1960-20d2-476a-a98b-79c1dc135aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:30.338308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2daa1960-20d2-476a-a98b-79c1dc135aa6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:30.339500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2daa1960-20d2-476a-a98b-79c1dc135aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:30.437391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 652/1325] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:30.721790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da388b1-f214-47fd-a23c-2a75a1cf1a39 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:30.723415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6da388b1-f214-47fd-a23c-2a75a1cf1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:30.834018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da388b1-f214-47fd-a23c-2a75a1cf1a39 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:30.906454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:30.907060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:30.907337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:30.907610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:30.909212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:30.926932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:31.019496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:31.021175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aee68-248d-4e36-b055-f3ccf27bd747 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:31.040334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 674/1326] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:33.007767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f04733-6509-444f-8be3-6d3a525b8930 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:33.008327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f04733-6509-444f-8be3-6d3a525b8930 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:33.008327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f04733-6509-444f-8be3-6d3a525b8930 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:33.009673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 653/1327] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:33.015280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eada4ab-0620-4024-ad6d-f4c727540470 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:33.015821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eada4ab-0620-4024-ad6d-f4c727540470 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:33.015821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eada4ab-0620-4024-ad6d-f4c727540470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:33.086697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4eada4ab-0620-4024-ad6d-f4c727540470 None None] MFA Rules not processed for user `8fb4793c3a0843b1ab85af535af499d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:33.087966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4eada4ab-0620-4024-ad6d-f4c727540470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:33.157828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:33.191420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 675/1328] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:33.477637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f04733-6509-444f-8be3-6d3a525b8930 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:33.479273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c4f04733-6509-444f-8be3-6d3a525b8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:33.514986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:33.591893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f04733-6509-444f-8be3-6d3a525b8930 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:33.668156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:33.668701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:33.668982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:33.669289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:33.670989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:33.758034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:33.792705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:33.794221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfc9d-cd8e-46cb-ba42-d648d2d65e28 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:33.812038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 654/1329] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:35.985631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c78ea-bbc0-44e2-a12c-cf9f50d140ca None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:35.986146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c78ea-bbc0-44e2-a12c-cf9f50d140ca None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:35.986240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c78ea-bbc0-44e2-a12c-cf9f50d140ca None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:35.987563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 676/1330] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:35.992893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7739-674e-4d77-83c1-06ab566fb981 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:35.993380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7739-674e-4d77-83c1-06ab566fb981 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:35.993484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7739-674e-4d77-83c1-06ab566fb981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:36.060245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5bff7739-674e-4d77-83c1-06ab566fb981 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:36.061487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5bff7739-674e-4d77-83c1-06ab566fb981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:36.161465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 655/1331] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:36.450067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c78ea-bbc0-44e2-a12c-cf9f50d140ca None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:36.451601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e77c78ea-bbc0-44e2-a12c-cf9f50d140ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:36.552741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c78ea-bbc0-44e2-a12c-cf9f50d140ca None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:36.628827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:36.629574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:36.629851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:36.630124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:36.631962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:36.659058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:36.739966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:36.741371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd863ad-49cc-4c3e-8e25-9ed423786629 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:36.759976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 677/1332] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:38.728525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4d1f-ab4f-4cb1-b454-5d860b316235 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:38.729085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4d1f-ab4f-4cb1-b454-5d860b316235 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:38.729085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c4d1f-ab4f-4cb1-b454-5d860b316235 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:38.730442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 656/1333] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:38.735589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a291bb-550f-4ea4-bfdc-41fe358f5c10 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:38.736002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a291bb-550f-4ea4-bfdc-41fe358f5c10 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:38.736152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a291bb-550f-4ea4-bfdc-41fe358f5c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:38.801552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-82a291bb-550f-4ea4-bfdc-41fe358f5c10 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:38.802783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82a291bb-550f-4ea4-bfdc-41fe358f5c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:38.876350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:38.899920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 678/1334] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:39.189993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4d1f-ab4f-4cb1-b454-5d860b316235 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:39.191643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-028c4d1f-ab4f-4cb1-b454-5d860b316235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:39.231737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:39.295810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c4d1f-ab4f-4cb1-b454-5d860b316235 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:39.369551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:39.370163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:39.370444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:39.370721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:39.372329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:39.462525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:39.487675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:39.489682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b62816-8610-4aff-81a1-74ddc5f214b2 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:39.507643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 657/1335] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:41.734840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd434d-f7ba-47db-834c-4129e6010490 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:41.735369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd434d-f7ba-47db-834c-4129e6010490 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:41.735369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd434d-f7ba-47db-834c-4129e6010490 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:41.736772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 679/1336] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:41.742609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9bda-510d-4e25-975a-45b899dc295a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:41.743017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9bda-510d-4e25-975a-45b899dc295a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:41.743162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc9bda-510d-4e25-975a-45b899dc295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:41.818124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1cdc9bda-510d-4e25-975a-45b899dc295a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:41.819337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1cdc9bda-510d-4e25-975a-45b899dc295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:41.914122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 658/1337] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:42.200279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd434d-f7ba-47db-834c-4129e6010490 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:42.201891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-16fd434d-f7ba-47db-834c-4129e6010490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:42.307916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd434d-f7ba-47db-834c-4129e6010490 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:42.378581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:42.379207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:42.379484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:42.379752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:42.381355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:42.417516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:42.489731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:42.491116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a4c83-e4c2-48eb-8a5c-dfe59136632d service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:42.509419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 680/1338] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:46.389056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbe882-9cab-47e9-8f23-4b0aa912f5b4 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:46.389620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbe882-9cab-47e9-8f23-4b0aa912f5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:46.389620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbe882-9cab-47e9-8f23-4b0aa912f5b4 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:46.390984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 659/1339] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:46.397060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41177c49-dcd9-4949-b012-f5541fcbaa49 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:46.397550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41177c49-dcd9-4949-b012-f5541fcbaa49 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:46.397659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41177c49-dcd9-4949-b012-f5541fcbaa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:46.464348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-41177c49-dcd9-4949-b012-f5541fcbaa49 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:46.465588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-41177c49-dcd9-4949-b012-f5541fcbaa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:46.553406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:46.565059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 681/1340] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:46.849623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbe882-9cab-47e9-8f23-4b0aa912f5b4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:46.851160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f4cbe882-9cab-47e9-8f23-4b0aa912f5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:46.901301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:46.957616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbe882-9cab-47e9-8f23-4b0aa912f5b4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:47.032978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:47.033636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:47.033948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:47.034223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:47.035857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:47.132371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:47.148876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:47.150383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b602e7-25df-40bf-80c9-539fe317e667 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:47.168826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 660/1341] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:49.759624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923167-5a3d-4ed4-8cfc-f1556798a331 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:49.760148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923167-5a3d-4ed4-8cfc-f1556798a331 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:49.760148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18923167-5a3d-4ed4-8cfc-f1556798a331 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:49.761576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 682/1342] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:49.766705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84d25-94b8-41f6-9394-ff355343ee6c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:49.767135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84d25-94b8-41f6-9394-ff355343ee6c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:49.767269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84d25-94b8-41f6-9394-ff355343ee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:49.834293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3bf84d25-94b8-41f6-9394-ff355343ee6c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:49.835515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3bf84d25-94b8-41f6-9394-ff355343ee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:49.939322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 661/1343] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:50.228187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923167-5a3d-4ed4-8cfc-f1556798a331 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:50.229739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-18923167-5a3d-4ed4-8cfc-f1556798a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:50.337088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18923167-5a3d-4ed4-8cfc-f1556798a331 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:50.415440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:50.416049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:50.416331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:50.416605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:50.418305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:50.464331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:50.534494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:50.536174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fae90c-9a34-495d-ae4e-7c2b6f34fd91 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:50.556139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 683/1344] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:14:54.501195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae829f04-e88c-4458-b4e6-742dfa968e76 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:54.503034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae829f04-e88c-4458-b4e6-742dfa968e76 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:54.503034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae829f04-e88c-4458-b4e6-742dfa968e76 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:54.506463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 662/1345] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:14:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:54.509401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e7b6-c401-4b44-a332-1017f6d1460e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:54.510720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e7b6-c401-4b44-a332-1017f6d1460e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:54.511119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381e7b6-c401-4b44-a332-1017f6d1460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:54.587231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5381e7b6-c401-4b44-a332-1017f6d1460e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:54.588448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5381e7b6-c401-4b44-a332-1017f6d1460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:54.693730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:54.697492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 684/1346] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:14:55.005207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fa4eb-86d3-4ec0-9d8e-bbfb32f08340 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:55.005568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fa4eb-86d3-4ec0-9d8e-bbfb32f08340 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:55.005911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fa4eb-86d3-4ec0-9d8e-bbfb32f08340 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:55.007349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 663/1347] 10.222.0.88 () {54 vars in 965 bytes} [Mon Aug 29 23:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:14:55.013761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19bac-1eb2-4c3e-bec1-8e39819eb06e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:55.014103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19bac-1eb2-4c3e-bec1-8e39819eb06e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:55.014315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19bac-1eb2-4c3e-bec1-8e39819eb06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:55.094285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20d19bac-1eb2-4c3e-bec1-8e39819eb06e None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:14:55.095426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20d19bac-1eb2-4c3e-bec1-8e39819eb06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:55.178783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 685/1348] 10.222.0.88 () {58 vars in 1062 bytes} [Mon Aug 29 23:14:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:14:55.187834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fa4eb-86d3-4ec0-9d8e-bbfb32f08340 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:14:55.189393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-729fa4eb-86d3-4ec0-9d8e-bbfb32f08340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:55.247341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:55.296166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fa4eb-86d3-4ec0-9d8e-bbfb32f08340 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:14:55.370570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:14:55.371102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:14:55.371382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:14:55.371652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:14:55.373270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:14:55.477776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:14:55.481679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:14:55.483108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8ef22-2467-4131-8930-7b11434f979b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:14:55.500490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 664/1349] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:00.826217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ea8fd-ccb4-47f5-9f99-eb5cadedc47f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:00.826652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ea8fd-ccb4-47f5-9f99-eb5cadedc47f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:00.826652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ea8fd-ccb4-47f5-9f99-eb5cadedc47f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:00.827876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 686/1350] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:00.833122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7345e-052b-4e04-86f0-895b7a00dc7d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:00.834526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7345e-052b-4e04-86f0-895b7a00dc7d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:00.835240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7345e-052b-4e04-86f0-895b7a00dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:00.934915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3db7345e-052b-4e04-86f0-895b7a00dc7d None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:00.936367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3db7345e-052b-4e04-86f0-895b7a00dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:01.102529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 665/1351] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:15:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:05.176858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=59 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:05.379747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5319bcd-7686-47ce-8603-cd4397ecec53 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:05.380310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5319bcd-7686-47ce-8603-cd4397ecec53 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:05.380755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5319bcd-7686-47ce-8603-cd4397ecec53 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:05.382586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 687/1352] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:05.387725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c669-4071-4b4b-b0a1-ba65cc11ccf4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:05.388510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c669-4071-4b4b-b0a1-ba65cc11ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:05.388942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c669-4071-4b4b-b0a1-ba65cc11ccf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:05.446182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:05.471693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0c95c669-4071-4b4b-b0a1-ba65cc11ccf4 None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:05.473131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c95c669-4071-4b4b-b0a1-ba65cc11ccf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:05.597444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 666/1353] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:15:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:06.914637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5099-e076-45f7-a8fc-b6ac42591677 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:06.915157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5099-e076-45f7-a8fc-b6ac42591677 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:06.915157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5099-e076-45f7-a8fc-b6ac42591677 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:06.916566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 688/1354] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:06.921745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1260-7a0f-44fd-905b-cbedcaf05696 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:06.922169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1260-7a0f-44fd-905b-cbedcaf05696 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:06.922356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1260-7a0f-44fd-905b-cbedcaf05696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:07.000035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9d0c1260-7a0f-44fd-905b-cbedcaf05696 None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:07.001273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9d0c1260-7a0f-44fd-905b-cbedcaf05696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:07.045789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:07.112094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 667/1355] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:15:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:10.455994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a02d86-4411-4e65-ac48-097086d2806a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:10.456510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a02d86-4411-4e65-ac48-097086d2806a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:10.456616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a02d86-4411-4e65-ac48-097086d2806a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:10.458138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 689/1356] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:10.464451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db957a-9453-4c31-9789-e724e912a098 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:10.464867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db957a-9453-4c31-9789-e724e912a098 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:10.465005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db957a-9453-4c31-9789-e724e912a098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:10.554510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c9db957a-9453-4c31-9789-e724e912a098 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:10.555722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c9db957a-9453-4c31-9789-e724e912a098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:10.702824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 668/1357] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:11.004502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940edf8-33a4-4cdf-9f28-35bed86af8db None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:11.005696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940edf8-33a4-4cdf-9f28-35bed86af8db None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:11.006311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940edf8-33a4-4cdf-9f28-35bed86af8db None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:11.008345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 690/1358] 10.222.0.88 () {54 vars in 962 bytes} [Mon Aug 29 23:15:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:11.018956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659f2f-53db-4f0f-973d-f3e64f9d7849 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:11.020223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659f2f-53db-4f0f-973d-f3e64f9d7849 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:11.021465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659f2f-53db-4f0f-973d-f3e64f9d7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:11.043998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:11.125329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-68659f2f-53db-4f0f-973d-f3e64f9d7849 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:11.126588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-68659f2f-53db-4f0f-973d-f3e64f9d7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:11.256375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 669/1359] 10.222.0.88 () {58 vars in 1059 bytes} [Mon Aug 29 23:15:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:15:11.264637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940edf8-33a4-4cdf-9f28-35bed86af8db None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:11.266202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a940edf8-33a4-4cdf-9f28-35bed86af8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:11.422428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940edf8-33a4-4cdf-9f28-35bed86af8db None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:11.502283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:11.544392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:11.545018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:11.545321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:11.545600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:11.547192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:11.641241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:11.642867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f8c3d-671a-4ec7-b454-f6aaff60c6f1 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:11.661776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 691/1360] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:13.841828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372ec7-c9c3-4dc0-b6ad-741ed57fadab None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:13.842453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372ec7-c9c3-4dc0-b6ad-741ed57fadab None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:13.842453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd372ec7-c9c3-4dc0-b6ad-741ed57fadab None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:13.844121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 670/1361] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:13.850312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d03386-bac3-4eaa-b3f2-5b2a23f98014 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:13.850844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d03386-bac3-4eaa-b3f2-5b2a23f98014 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:13.850844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d03386-bac3-4eaa-b3f2-5b2a23f98014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:13.927131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-61d03386-bac3-4eaa-b3f2-5b2a23f98014 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:13.928903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-61d03386-bac3-4eaa-b3f2-5b2a23f98014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:13.972052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:14.058668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 692/1362] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:14.358068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd372ec7-c9c3-4dc0-b6ad-741ed57fadab None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:14.359685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fd372ec7-c9c3-4dc0-b6ad-741ed57fadab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:14.433726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:14.523558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd372ec7-c9c3-4dc0-b6ad-741ed57fadab None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:14.662910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:14.663605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:14.664104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:14.664390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:14.666199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:14.695918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:14.779614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:14.781278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9b60a-cf1e-48f2-ae24-0fdc76836c37 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:14.801747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 671/1363] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:17.045507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb29d8-1cfd-4d5f-9b07-8cb0fb44051d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:17.046054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb29d8-1cfd-4d5f-9b07-8cb0fb44051d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:17.046054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb29d8-1cfd-4d5f-9b07-8cb0fb44051d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:17.047412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 693/1364] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:17.053425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da174e1-c9d5-4050-9bc3-d9597847c289 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:17.054232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da174e1-c9d5-4050-9bc3-d9597847c289 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:17.054518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da174e1-c9d5-4050-9bc3-d9597847c289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:17.126018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6da174e1-c9d5-4050-9bc3-d9597847c289 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:17.127228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6da174e1-c9d5-4050-9bc3-d9597847c289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:17.230932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:17.240908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 672/1365] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:17.523323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2754-8b8f-487f-a428-03e6f6a210e3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:17.523648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2754-8b8f-487f-a428-03e6f6a210e3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:17.523916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c2754-8b8f-487f-a428-03e6f6a210e3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:17.525341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 694/1366] 10.222.0.88 () {54 vars in 962 bytes} [Mon Aug 29 23:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:17.530785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12eeab-a904-452d-b2f9-3e7985908e8f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:17.531184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12eeab-a904-452d-b2f9-3e7985908e8f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:17.531823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12eeab-a904-452d-b2f9-3e7985908e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:17.617024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9f12eeab-a904-452d-b2f9-3e7985908e8f None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:17.621008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9f12eeab-a904-452d-b2f9-3e7985908e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:17.748081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 673/1367] 10.222.0.88 () {58 vars in 1059 bytes} [Mon Aug 29 23:15:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:15:17.756612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c2754-8b8f-487f-a428-03e6f6a210e3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:17.758289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-535c2754-8b8f-487f-a428-03e6f6a210e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:17.913880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c2754-8b8f-487f-a428-03e6f6a210e3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:17.936829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:18.044780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:18.045424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:18.045708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:18.046233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:18.047638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:18.142450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:18.144990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278cab4-195f-4599-a1e0-7bcaa0a94f10 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:18.167459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 695/1368] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:18.792782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0268-24d2-4943-ac42-278b6b702c17 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:18.793355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0268-24d2-4943-ac42-278b6b702c17 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:18.793355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0268-24d2-4943-ac42-278b6b702c17 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:18.794851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 674/1369] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:18.799803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b3d5-6be5-4704-9cf1-6b8aceab2e9f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:18.800146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b3d5-6be5-4704-9cf1-6b8aceab2e9f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:18.800421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b3d5-6be5-4704-9cf1-6b8aceab2e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:18.834931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:18.871932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cd65b3d5-6be5-4704-9cf1-6b8aceab2e9f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:18.873209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd65b3d5-6be5-4704-9cf1-6b8aceab2e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:18.975349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 696/1370] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:19.562364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb131045-5ae2-4f73-8689-f4e58707322f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:19.562827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb131045-5ae2-4f73-8689-f4e58707322f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:19.563205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb131045-5ae2-4f73-8689-f4e58707322f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:19.564760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 675/1371] 10.222.0.88 () {54 vars in 964 bytes} [Mon Aug 29 23:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:19.570426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11efdf-9366-4436-8a4f-6e8e32844d40 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:19.570964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11efdf-9366-4436-8a4f-6e8e32844d40 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:19.571123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11efdf-9366-4436-8a4f-6e8e32844d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:19.657388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3e11efdf-9366-4436-8a4f-6e8e32844d40 None None] MFA Rules not processed for user `1cda9da215144c6ca429f8787be283f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:19.658634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3e11efdf-9366-4436-8a4f-6e8e32844d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:19.710155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:19.744627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 697/1372] 10.222.0.88 () {58 vars in 1061 bytes} [Mon Aug 29 23:15:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:19.752769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb131045-5ae2-4f73-8689-f4e58707322f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:19.755650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cb131045-5ae2-4f73-8689-f4e58707322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:19.810748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:19.869068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb131045-5ae2-4f73-8689-f4e58707322f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:19.950619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:19.951159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:19.951481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:19.951703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:19.953372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:20.060651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:20.076153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:20.077653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92551d2-76f3-427b-900c-6bd18a2b0c3a service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:20.097351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 676/1373] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:20.190289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89cd6b-adfc-4226-bdca-23e6a70ab61a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:20.190565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89cd6b-adfc-4226-bdca-23e6a70ab61a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:20.190745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89cd6b-adfc-4226-bdca-23e6a70ab61a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:20.192928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 698/1374] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:20.199462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c973-6a5d-43f3-9e05-1ec02f2839ba None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:20.199824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c973-6a5d-43f3-9e05-1ec02f2839ba None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:20.200163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00c973-6a5d-43f3-9e05-1ec02f2839ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:20.278534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3c00c973-6a5d-43f3-9e05-1ec02f2839ba None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:20.284461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c00c973-6a5d-43f3-9e05-1ec02f2839ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:20.392480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 677/1375] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:20.682574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89cd6b-adfc-4226-bdca-23e6a70ab61a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:20.684118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a89cd6b-adfc-4226-bdca-23e6a70ab61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:20.831572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89cd6b-adfc-4226-bdca-23e6a70ab61a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:20.883449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:20.945768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:20.946309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:20.946591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:20.946868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:20.948473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:21.038793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:21.040396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dead2-1569-4f29-bc50-8717fc83bbc7 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:21.058727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 699/1376] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:23.036834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ca9a7-33fa-476f-8980-1eea08744483 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:23.037371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ca9a7-33fa-476f-8980-1eea08744483 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:23.037467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ca9a7-33fa-476f-8980-1eea08744483 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:23.038757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 678/1377] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:23.043968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382d8ea-033d-4c52-adb9-2dd05400a82f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:23.044367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382d8ea-033d-4c52-adb9-2dd05400a82f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:23.044555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382d8ea-033d-4c52-adb9-2dd05400a82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:23.115264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f382d8ea-033d-4c52-adb9-2dd05400a82f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:23.116487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f382d8ea-033d-4c52-adb9-2dd05400a82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:23.123204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:23.244593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 700/1378] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:23.542548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ca9a7-33fa-476f-8980-1eea08744483 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:23.544051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e82ca9a7-33fa-476f-8980-1eea08744483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:23.631375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:23.739658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ca9a7-33fa-476f-8980-1eea08744483 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:23.859437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:23.860048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:23.860326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:23.860596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:23.862209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:23.881853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:23.959236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:23.960839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ef87-d8e2-40b3-81d0-c17de750b4bc service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:23.980795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 679/1379] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:25.927395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d281fc-40a0-4f53-a691-cf2df3e56437 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:25.927863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d281fc-40a0-4f53-a691-cf2df3e56437 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:25.927941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d281fc-40a0-4f53-a691-cf2df3e56437 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:25.929597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 701/1380] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:25.934713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1755-42a9-499a-ae15-73633101f22d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:25.935139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1755-42a9-499a-ae15-73633101f22d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:25.935317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1755-42a9-499a-ae15-73633101f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:26.008336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ca9b1755-42a9-499a-ae15-73633101f22d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:26.009559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ca9b1755-42a9-499a-ae15-73633101f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:26.104824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:26.111737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 680/1381] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:26.411224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d281fc-40a0-4f53-a691-cf2df3e56437 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:26.412913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-62d281fc-40a0-4f53-a691-cf2df3e56437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:26.575165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:26.591392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d281fc-40a0-4f53-a691-cf2df3e56437 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:26.733992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:26.734643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:26.734932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:26.735211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:26.736800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:26.836814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:26.838431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad59dc5-7967-4f16-b69d-a096054e6f54 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:26.850074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:26.861272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 702/1382] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:28.821662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2976-ecbb-4667-86a7-5f01b3766969 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:28.822215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2976-ecbb-4667-86a7-5f01b3766969 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:28.822349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2976-ecbb-4667-86a7-5f01b3766969 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:28.824079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 681/1383] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:28.829711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d5d8-cfd1-4983-87eb-d732f0e90068 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:28.830181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d5d8-cfd1-4983-87eb-d732f0e90068 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:28.830308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d5d8-cfd1-4983-87eb-d732f0e90068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:28.907539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-eb59d5d8-cfd1-4983-87eb-d732f0e90068 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:28.909556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eb59d5d8-cfd1-4983-87eb-d732f0e90068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:29.066518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 703/1384] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:29.366445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2976-ecbb-4667-86a7-5f01b3766969 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:29.368360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0cab2976-ecbb-4667-86a7-5f01b3766969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:29.534866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab2976-ecbb-4667-86a7-5f01b3766969 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:29.611073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:29.662911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:29.663520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:29.663798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:29.664067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:29.665686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:29.760723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:29.762352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef13869-e415-4e4e-9f33-3755f375dc14 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:29.780563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 682/1385] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:31.822581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1583f1-9e9b-4af1-b1e6-63eb86cd68eb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:31.823125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1583f1-9e9b-4af1-b1e6-63eb86cd68eb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:31.823223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1583f1-9e9b-4af1-b1e6-63eb86cd68eb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:31.824604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 704/1386] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:31.831039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a4891-8b72-4855-ab03-8d00816cc5a0 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:31.831479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a4891-8b72-4855-ab03-8d00816cc5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:31.831683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a4891-8b72-4855-ab03-8d00816cc5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:31.912864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a45a4891-8b72-4855-ab03-8d00816cc5a0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:31.914147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a45a4891-8b72-4855-ab03-8d00816cc5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:31.948550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:32.032413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 683/1387] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:32.401867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1583f1-9e9b-4af1-b1e6-63eb86cd68eb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:32.403448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1e1583f1-9e9b-4af1-b1e6-63eb86cd68eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:32.487949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:32.566146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1583f1-9e9b-4af1-b1e6-63eb86cd68eb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:32.690653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:32.691228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:32.691535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:32.691826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:32.694299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:32.738092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:32.798871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:32.800695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f7483-2c7b-41f7-8b8e-b51ca18876b0 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:32.820517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 705/1388] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:34.772298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c765911-38ea-481f-b3f8-364686e17f5e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:34.772860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c765911-38ea-481f-b3f8-364686e17f5e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:34.773010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c765911-38ea-481f-b3f8-364686e17f5e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:34.774566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 684/1389] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:34.779971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba6805-3009-4f37-aa5a-5bed2cfb7382 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:34.780392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba6805-3009-4f37-aa5a-5bed2cfb7382 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:34.780582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba6805-3009-4f37-aa5a-5bed2cfb7382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:34.848509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3fba6805-3009-4f37-aa5a-5bed2cfb7382 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:34.849779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3fba6805-3009-4f37-aa5a-5bed2cfb7382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:35.066744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 706/1390] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:35.353863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c765911-38ea-481f-b3f8-364686e17f5e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:35.355454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6c765911-38ea-481f-b3f8-364686e17f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:35.432455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1a82-2c9c-4bb1-9f15-c4829b4a7bb2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:35.432754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1a82-2c9c-4bb1-9f15-c4829b4a7bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:35.433033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead1a82-2c9c-4bb1-9f15-c4829b4a7bb2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:35.434465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 707/1391] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:35.439695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38786-7897-455a-a879-3c6be21529fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:35.439984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38786-7897-455a-a879-3c6be21529fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:35.440290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38786-7897-455a-a879-3c6be21529fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:35.456286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:35.507220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c765911-38ea-481f-b3f8-364686e17f5e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:35.509426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fce38786-7897-455a-a879-3c6be21529fd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:35.510644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fce38786-7897-455a-a879-3c6be21529fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:35.523670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:35.610070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 708/1392] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:15:35.627593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:35.628203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:35.628483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:35.628756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:35.630585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:35.720122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:35.721772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33a274-4afd-458c-bffe-6e9d6561bce8 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:35.740402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 685/1393] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:35.910401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ae489-9c10-4a00-97d1-db8f36cb7a48 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:35.911177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ae489-9c10-4a00-97d1-db8f36cb7a48 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:35.911291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ae489-9c10-4a00-97d1-db8f36cb7a48 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:35.912867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 709/1394] 10.222.0.88 () {54 vars in 967 bytes} [Mon Aug 29 23:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:35.918380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae873-2282-4796-a1f1-c41826f4a781 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:35.918918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae873-2282-4796-a1f1-c41826f4a781 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:35.918918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae873-2282-4796-a1f1-c41826f4a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:35.946401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:35.999121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-33aae873-2282-4796-a1f1-c41826f4a781 None None] MFA Rules not processed for user `016885b1849e4e3d990c3de23c479399`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:36.000316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-33aae873-2282-4796-a1f1-c41826f4a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:36.077897 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 686/1395] 10.222.0.88 () {58 vars in 1064 bytes} [Mon Aug 29 23:15:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:36.086196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ae489-9c10-4a00-97d1-db8f36cb7a48 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:36.087692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc0ae489-9c10-4a00-97d1-db8f36cb7a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:36.183969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:36.191203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ae489-9c10-4a00-97d1-db8f36cb7a48 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:36.267280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:36.267897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:36.268179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:36.268453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:36.270816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:36.381906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:36.383353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1b63d-807a-4a91-a194-734fa1cbd880 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:36.401933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 710/1396] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:37.141172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5d68-6cff-4c42-bdeb-2cb4ccb0216a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:37.141643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5d68-6cff-4c42-bdeb-2cb4ccb0216a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:37.141769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d5d68-6cff-4c42-bdeb-2cb4ccb0216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:37.210349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ef9d5d68-6cff-4c42-bdeb-2cb4ccb0216a None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:37.211557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef9d5d68-6cff-4c42-bdeb-2cb4ccb0216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:37.274071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:37.302783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 687/1397] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:15:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:37.348733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b90268-f00a-44c6-a222-d525690c238c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:37.349243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b90268-f00a-44c6-a222-d525690c238c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:37.349362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b90268-f00a-44c6-a222-d525690c238c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:37.350683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 711/1398] 10.222.0.88 () {54 vars in 943 bytes} [Mon Aug 29 23:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:15:37.357401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509e6-82b3-4168-aed1-290e74059d96 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:37.357706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509e6-82b3-4168-aed1-290e74059d96 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:37.357986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42509e6-82b3-4168-aed1-290e74059d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:37.435537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e42509e6-82b3-4168-aed1-290e74059d96 None None] MFA Rules not processed for user `a740dffa48ae44edb8f2a103bd8203c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:37.436663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e42509e6-82b3-4168-aed1-290e74059d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:37.547457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 688/1399] 10.222.0.88 () {58 vars in 1040 bytes} [Mon Aug 29 23:15:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:15:37.557240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b90268-f00a-44c6-a222-d525690c238c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:37.558826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6b90268-f00a-44c6-a222-d525690c238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:37.583267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:37.695623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad925-9745-44cf-ab1f-dfab593d5ef0 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:37.695837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad925-9745-44cf-ab1f-dfab593d5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:37.696081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ad925-9745-44cf-ab1f-dfab593d5ef0 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:37.697467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 689/1400] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:15:37.701001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b90268-f00a-44c6-a222-d525690c238c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:37.702427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:37.702776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:37.703122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:37.750675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:37.774175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:37.775395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:37.809549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:37.810153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:37.810426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:37.810697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:37.812307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:37.821301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:37.875463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 690/1401] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:15:37.897776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:37.899394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043e1f-272a-4771-ace9-e8415b77d406 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:37.907453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 712/1402] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:15:38.170930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:38.172760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:38.324083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe48b-bcd3-445a-be29-40a6ce3d6e7c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:38.328237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:38.472736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:38.473674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:38.474094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:38.474368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:38.476016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:38.585195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:38.591134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214630f2-8623-4804-a5f7-0631dae70778 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:38.615358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 691/1403] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:40.601906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246707d-2317-447c-bcc2-9cecf5d700bb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:40.602506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246707d-2317-447c-bcc2-9cecf5d700bb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:40.602506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246707d-2317-447c-bcc2-9cecf5d700bb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:40.603804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 713/1404] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:15:40.608990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d483c-0651-48de-92f7-5da104ce6333 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:40.609479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d483c-0651-48de-92f7-5da104ce6333 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:40.609589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d483c-0651-48de-92f7-5da104ce6333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:40.626001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:40.686690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-277d483c-0651-48de-92f7-5da104ce6333 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:40.687908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-277d483c-0651-48de-92f7-5da104ce6333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:40.792733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 692/1405] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:41.093542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246707d-2317-447c-bcc2-9cecf5d700bb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:41.095309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8246707d-2317-447c-bcc2-9cecf5d700bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:41.260219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246707d-2317-447c-bcc2-9cecf5d700bb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:41.263477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:41.401618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:41.402141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:41.402422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:41.402699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:41.404299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:41.502774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:41.505345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d84e9d-f1ae-4178-9bb9-f585dfeaa09f service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:41.526143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 714/1406] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:15:43.521397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496923b-a2cc-4970-89a7-5b10e496cc43 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:43.521949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496923b-a2cc-4970-89a7-5b10e496cc43 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:43.521949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496923b-a2cc-4970-89a7-5b10e496cc43 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:43.523275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 693/1407] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:15:43.528624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ef41-d5db-43d3-a915-ec36bf4a61fe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:43.529086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ef41-d5db-43d3-a915-ec36bf4a61fe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:43.529227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532ef41-d5db-43d3-a915-ec36bf4a61fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:43.541874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:43.606122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2532ef41-d5db-43d3-a915-ec36bf4a61fe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:15:43.607742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2532ef41-d5db-43d3-a915-ec36bf4a61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:43.724599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 715/1408] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:15:44.037438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496923b-a2cc-4970-89a7-5b10e496cc43 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:15:44.039229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e496923b-a2cc-4970-89a7-5b10e496cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:44.138568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:44.213402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496923b-a2cc-4970-89a7-5b10e496cc43 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:15:44.375539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:15:44.375886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:15:44.376049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:15:44.376204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:15:44.380474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:15:44.459770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:44.505669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:15:44.507808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f3acc-f366-4cdc-a055-2b90377bae16 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:15:44.527025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 694/1409] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:15:53.722091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=62 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:15:54.524696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=23 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:00.674363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51f30-9c0c-48eb-a0d4-1aff03d7031a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:00.674920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51f30-9c0c-48eb-a0d4-1aff03d7031a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:00.674920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51f30-9c0c-48eb-a0d4-1aff03d7031a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:00.677038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 716/1410] 10.222.0.88 () {54 vars in 918 bytes} [Mon Aug 29 23:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:00.682159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2313e-66fe-4353-a41b-617a76e4865e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:00.682588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2313e-66fe-4353-a41b-617a76e4865e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:00.682690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2313e-66fe-4353-a41b-617a76e4865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:00.758075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-eeb2313e-66fe-4353-a41b-617a76e4865e None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:00.759261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eeb2313e-66fe-4353-a41b-617a76e4865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:00.865552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 695/1411] 10.222.0.88 () {58 vars in 1015 bytes} [Mon Aug 29 23:16:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:16:00.879852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84fd51-057d-4294-82c0-168abc243a25 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:00.880073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84fd51-057d-4294-82c0-168abc243a25 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:00.880348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84fd51-057d-4294-82c0-168abc243a25 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:00.881757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 717/1412] 10.222.0.88 () {54 vars in 918 bytes} [Mon Aug 29 23:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:00.886219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161ea7-5042-44a6-b7e7-e29ce2b5d8f2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:00.886504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161ea7-5042-44a6-b7e7-e29ce2b5d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:00.886776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20161ea7-5042-44a6-b7e7-e29ce2b5d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:00.958666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:00.962971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-20161ea7-5042-44a6-b7e7-e29ce2b5d8f2 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:00.964769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-20161ea7-5042-44a6-b7e7-e29ce2b5d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:01.079037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 696/1413] 10.222.0.88 () {58 vars in 1015 bytes} [Mon Aug 29 23:16:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:16:03.459453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde5186-07f6-44c1-ba68-2616080bb80a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:03.460105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde5186-07f6-44c1-ba68-2616080bb80a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:03.460105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde5186-07f6-44c1-ba68-2616080bb80a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:03.461424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:03.466539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4325c-72fb-4683-9a98-2704ead786d4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:03.466979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4325c-72fb-4683-9a98-2704ead786d4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:03.467121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4325c-72fb-4683-9a98-2704ead786d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:03.533781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bbe4325c-72fb-4683-9a98-2704ead786d4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:03.535069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bbe4325c-72fb-4683-9a98-2704ead786d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:03.590108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:03.632113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:16:03.919269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde5186-07f6-44c1-ba68-2616080bb80a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:03.920783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cdde5186-07f6-44c1-ba68-2616080bb80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:04.067607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde5186-07f6-44c1-ba68-2616080bb80a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:04.138926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:04.181474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:04.182001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:04.182281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:04.182552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:04.184143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:04.274008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:04.275594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdead5-c01f-4f9b-8473-fb97a26db943 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:04.293508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 719/1416] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:05.186458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415183-60ce-473d-8f92-8a941ec76b33 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:05.187038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415183-60ce-473d-8f92-8a941ec76b33 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:05.187038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b415183-60ce-473d-8f92-8a941ec76b33 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:05.188361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:05.193757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d294-0d51-43a7-bc22-127838e7abbe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:05.194187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d294-0d51-43a7-bc22-127838e7abbe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:05.194298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62d294-0d51-43a7-bc22-127838e7abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:05.268195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7f62d294-0d51-43a7-bc22-127838e7abbe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:05.270179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7f62d294-0d51-43a7-bc22-127838e7abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:05.297025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:05.365339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:05.515538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415183-60ce-473d-8f92-8a941ec76b33 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:05.516976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5b415183-60ce-473d-8f92-8a941ec76b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:05.664979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b415183-60ce-473d-8f92-8a941ec76b33 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:05.704704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:05.778193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:05.778714 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:05.778991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:05.779259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:05.780857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:05.870308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:05.871915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c10e1-e67a-45c0-b6f9-f45b4038877e service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:05.889400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 699/1419] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:06.786867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01648f-b2a2-4a80-8d22-371e8ae5fcf9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:06.787488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01648f-b2a2-4a80-8d22-371e8ae5fcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:06.787488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01648f-b2a2-4a80-8d22-371e8ae5fcf9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:06.788781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:06.793786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942c05b-ef2a-444b-bf3f-d0d4f211aeff None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:06.794217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942c05b-ef2a-444b-bf3f-d0d4f211aeff None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:06.794366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942c05b-ef2a-444b-bf3f-d0d4f211aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:06.848525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:06.870210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d942c05b-ef2a-444b-bf3f-d0d4f211aeff None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:06.871470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d942c05b-ef2a-444b-bf3f-d0d4f211aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:06.974992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:07.131764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01648f-b2a2-4a80-8d22-371e8ae5fcf9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:07.133306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9f01648f-b2a2-4a80-8d22-371e8ae5fcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:07.280094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01648f-b2a2-4a80-8d22-371e8ae5fcf9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:07.292781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:07.393146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:07.393672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:07.394493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:07.394762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:07.396347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:07.485940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:07.487597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1fce1-64f7-4dd3-8d2d-06422851aa07 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:07.506058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 722/1422] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:08.376627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb398f-3a02-4b44-b4b2-376d66700784 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:08.377194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb398f-3a02-4b44-b4b2-376d66700784 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:08.377194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb398f-3a02-4b44-b4b2-376d66700784 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:08.379069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:08.384129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b617-bb9e-4e59-a908-3723603620b4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:08.384573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b617-bb9e-4e59-a908-3723603620b4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:08.384680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52b617-bb9e-4e59-a908-3723603620b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:08.404866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:08.461375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bc52b617-bb9e-4e59-a908-3723603620b4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:08.462572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bc52b617-bb9e-4e59-a908-3723603620b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:08.556746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:08.708862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb398f-3a02-4b44-b4b2-376d66700784 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:08.710334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aabb398f-3a02-4b44-b4b2-376d66700784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:08.827527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:08.864760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb398f-3a02-4b44-b4b2-376d66700784 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:08.976887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:08.977514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:08.977795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:08.978066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:08.979660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:09.058491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:09.072371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:09.074049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec0345-5b1b-4e15-a8b1-8c58ebf8c5d0 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:09.091631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 702/1425] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:09.942473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d975b36-210c-40ab-808d-42947fed26eb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:09.943011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d975b36-210c-40ab-808d-42947fed26eb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:09.943011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d975b36-210c-40ab-808d-42947fed26eb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:09.944272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:09.949257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7a09-3ca5-4615-91e6-42689240f3fd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:09.949681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7a09-3ca5-4615-91e6-42689240f3fd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:09.949810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7a09-3ca5-4615-91e6-42689240f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:10.026453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a44a7a09-3ca5-4615-91e6-42689240f3fd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:10.028173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a44a7a09-3ca5-4615-91e6-42689240f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:10.124519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:10.275177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d975b36-210c-40ab-808d-42947fed26eb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:10.276639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1d975b36-210c-40ab-808d-42947fed26eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:10.360213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:10.422443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d975b36-210c-40ab-808d-42947fed26eb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:10.535033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:10.535730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:10.536021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:10.536294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:10.537942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:10.586907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:10.629431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:10.631027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa0daf-f261-4758-b454-26be6fd120c0 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:10.649038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 725/1428] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:11.469726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485a23-f1ea-4250-927b-b83a978ae835 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:11.470282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485a23-f1ea-4250-927b-b83a978ae835 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:11.470282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485a23-f1ea-4250-927b-b83a978ae835 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:11.471532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:11.476844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6236fb-fcd1-4d32-b7b5-178265c758ec None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:11.477313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6236fb-fcd1-4d32-b7b5-178265c758ec None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:11.477410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6236fb-fcd1-4d32-b7b5-178265c758ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:11.552004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-de6236fb-fcd1-4d32-b7b5-178265c758ec None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:11.553232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-de6236fb-fcd1-4d32-b7b5-178265c758ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:11.651132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:11.804774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1485a23-f1ea-4250-927b-b83a978ae835 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:11.806339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a1485a23-f1ea-4250-927b-b83a978ae835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:11.854574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:11.952898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1485a23-f1ea-4250-927b-b83a978ae835 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:12.069588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:12.070127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:12.070408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:12.070679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:12.072283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:12.079218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:12.164150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:12.165795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0177-26d9-414f-bcbe-f7ad086c62d3 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:12.184089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 705/1431] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:12.994161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da5183-314f-497b-922a-01744a339820 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:12.994719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da5183-314f-497b-922a-01744a339820 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:12.994719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da5183-314f-497b-922a-01744a339820 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:12.996051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:13.001182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee353-eceb-4d90-ba79-af8d5850a4a9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:13.001563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee353-eceb-4d90-ba79-af8d5850a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:13.001735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aee353-eceb-4d90-ba79-af8d5850a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:13.080400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-12aee353-eceb-4d90-ba79-af8d5850a4a9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:13.081767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-12aee353-eceb-4d90-ba79-af8d5850a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:13.148072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:13.177130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:13.328996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da5183-314f-497b-922a-01744a339820 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:13.330556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c2da5183-314f-497b-922a-01744a339820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:13.348817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:13.481263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da5183-314f-497b-922a-01744a339820 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:13.569469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:13.595917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:13.596456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:13.596739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:13.597014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:13.598809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:13.687260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:13.688876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd465bb-b32b-4128-94a8-c89d77e694e4 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:13.707474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 728/1434] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:14.540966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5321-099d-431e-88a0-29d8369c611a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:14.541564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5321-099d-431e-88a0-29d8369c611a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:14.541997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab5321-099d-431e-88a0-29d8369c611a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:14.544527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:16:14.550368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3cd5-69f6-4f4a-825f-5e7e92f80fc3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:14.551105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3cd5-69f6-4f4a-825f-5e7e92f80fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:14.551105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3cd5-69f6-4f4a-825f-5e7e92f80fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:14.640704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-47cc3cd5-69f6-4f4a-825f-5e7e92f80fc3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:14.641983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47cc3cd5-69f6-4f4a-825f-5e7e92f80fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:14.687879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:14.748441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:14.905987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5321-099d-431e-88a0-29d8369c611a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:14.908482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-20ab5321-099d-431e-88a0-29d8369c611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:15.079004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab5321-099d-431e-88a0-29d8369c611a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:15.138621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:15.219716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:15.220218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:15.220494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:15.220763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:15.223317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:15.320310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:15.321964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaba58-b98c-432d-ab37-db57833582a9 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:15.340248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 708/1437] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:16.151156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5669-46da-43cc-ae0f-10c4814b79f2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:16.151587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5669-46da-43cc-ae0f-10c4814b79f2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:16.151731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5669-46da-43cc-ae0f-10c4814b79f2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:16.153214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:16.158447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffcb28-ef7a-49cb-8d41-e645aab6fe4f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:16.158865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffcb28-ef7a-49cb-8d41-e645aab6fe4f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:16.159762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffcb28-ef7a-49cb-8d41-e645aab6fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:16.236580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-85ffcb28-ef7a-49cb-8d41-e645aab6fe4f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:16.237884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-85ffcb28-ef7a-49cb-8d41-e645aab6fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:16.239990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:16.338212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:16:16.488590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5669-46da-43cc-ae0f-10c4814b79f2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:16.490132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-223e5669-46da-43cc-ae0f-10c4814b79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:16.636525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5669-46da-43cc-ae0f-10c4814b79f2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:16.663696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:16.753405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:16.754268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:16.754551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:16.754828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:16.756453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:16.846056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:16.847915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de634-0d8b-49c1-a1aa-4aba2c108f07 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:16.866163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 731/1440] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:18.673135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358d04-f881-4d33-bd98-fab461e016bf None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:18.673634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358d04-f881-4d33-bd98-fab461e016bf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:18.673731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358d04-f881-4d33-bd98-fab461e016bf None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:18.675039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:18.680320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86506bc3-2c9a-4189-8a32-010aacdceabe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:18.680772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86506bc3-2c9a-4189-8a32-010aacdceabe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:18.680882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86506bc3-2c9a-4189-8a32-010aacdceabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:18.722217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:18.747245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-86506bc3-2c9a-4189-8a32-010aacdceabe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:18.748447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86506bc3-2c9a-4189-8a32-010aacdceabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:18.844905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:19.132491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358d04-f881-4d33-bd98-fab461e016bf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:19.134071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-08358d04-f881-4d33-bd98-fab461e016bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:19.235356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358d04-f881-4d33-bd98-fab461e016bf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:19.267655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:19.309257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:19.309854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:19.310126 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:19.310394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:19.311957 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:19.419544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:19.420875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a5f0-8f46-4224-b0e5-1f0691d4295b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:19.438841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 711/1443] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:21.542637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c2bc3-efa4-43fe-9d65-49d8db47e4a8 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:21.543230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c2bc3-efa4-43fe-9d65-49d8db47e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:21.543230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c2bc3-efa4-43fe-9d65-49d8db47e4a8 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:21.544544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:21.549935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b771e-756a-40de-9954-a320cf63ef71 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:21.550348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b771e-756a-40de-9954-a320cf63ef71 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:21.550584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b771e-756a-40de-9954-a320cf63ef71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:21.618045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-204b771e-756a-40de-9954-a320cf63ef71 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:21.619255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-204b771e-756a-40de-9954-a320cf63ef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:21.632616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:21.718299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:22.001804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c2bc3-efa4-43fe-9d65-49d8db47e4a8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:22.003480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-516c2bc3-efa4-43fe-9d65-49d8db47e4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:22.105936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c2bc3-efa4-43fe-9d65-49d8db47e4a8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:22.117776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:22.179204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:22.179805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:22.180082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:22.180351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:22.181963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:22.290330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:22.291763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765d889-f5eb-4c8f-b987-d2f82b7fb040 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:22.310889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 734/1446] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:24.527255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e1a03-8241-4432-920f-bfbe4be36aed None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:24.527830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e1a03-8241-4432-920f-bfbe4be36aed None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:24.527830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e1a03-8241-4432-920f-bfbe4be36aed None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:24.529303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:24.534868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4ad3-846f-49d4-bfab-86b529f9ec3a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:24.535269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4ad3-846f-49d4-bfab-86b529f9ec3a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:24.535428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4ad3-846f-49d4-bfab-86b529f9ec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:24.583378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:24.604422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-adaf4ad3-846f-49d4-bfab-86b529f9ec3a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:24.605666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-adaf4ad3-846f-49d4-bfab-86b529f9ec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:24.702518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:24.996986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e1a03-8241-4432-920f-bfbe4be36aed None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:24.998545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b06e1a03-8241-4432-920f-bfbe4be36aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:25.102575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e1a03-8241-4432-920f-bfbe4be36aed None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:25.152184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:25.187443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:25.188051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:25.188810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:25.189089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:25.191468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:25.300325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:25.301827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9d4c4-9159-4734-ae1b-d38ea91949b7 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:25.319636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 714/1449] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:27.338507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b519-5c68-484e-ae55-12b555a3267c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:27.339097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b519-5c68-484e-ae55-12b555a3267c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:27.339097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407b519-5c68-484e-ae55-12b555a3267c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:27.340420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:27.345811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4c033-6cf0-4237-949a-f0cf9bcb0b82 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:27.346357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4c033-6cf0-4237-949a-f0cf9bcb0b82 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:27.346470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4c033-6cf0-4237-949a-f0cf9bcb0b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:27.413505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f0e4c033-6cf0-4237-949a-f0cf9bcb0b82 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:27.414723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0e4c033-6cf0-4237-949a-f0cf9bcb0b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:27.435362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:27.512151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:27.808794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407b519-5c68-484e-ae55-12b555a3267c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:27.810363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c407b519-5c68-484e-ae55-12b555a3267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:27.913474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407b519-5c68-484e-ae55-12b555a3267c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:27.932672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:27.986341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:27.986953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:27.987237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:27.987515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:27.989233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:28.100906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:28.102387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073b685-8cee-427e-bd7a-2eeeafcc833f service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:28.120972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 737/1452] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:30.082790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca339cb-2fe6-4ad0-891f-e245b61151c6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:30.083362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca339cb-2fe6-4ad0-891f-e245b61151c6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:30.083362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca339cb-2fe6-4ad0-891f-e245b61151c6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:30.084724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:30.090873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f9c2-1d22-4858-826a-be55c6d98b2d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:30.091301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f9c2-1d22-4858-826a-be55c6d98b2d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:30.091434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324f9c2-1d22-4858-826a-be55c6d98b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:30.158550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:30.161521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f324f9c2-1d22-4858-826a-be55c6d98b2d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:30.163350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f324f9c2-1d22-4858-826a-be55c6d98b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:30.260332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:30.554014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca339cb-2fe6-4ad0-891f-e245b61151c6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:30.555604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aca339cb-2fe6-4ad0-891f-e245b61151c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:30.658530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca339cb-2fe6-4ad0-891f-e245b61151c6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:30.707828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:30.732621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:30.733259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:30.733543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:30.733818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:30.735415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:30.844516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:30.845900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed65397-dfcd-4c91-8a76-7d2f3c3618c9 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:30.863836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 717/1455] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:32.814861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db78458-0d30-435d-87bd-4ff15461f11b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:32.815401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db78458-0d30-435d-87bd-4ff15461f11b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:32.815401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db78458-0d30-435d-87bd-4ff15461f11b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:32.817384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:16:32.822818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9992a5-1653-4ded-957f-874191efcf75 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:32.823239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9992a5-1653-4ded-957f-874191efcf75 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:32.823365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9992a5-1653-4ded-957f-874191efcf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:32.889640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fe9992a5-1653-4ded-957f-874191efcf75 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:32.890848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fe9992a5-1653-4ded-957f-874191efcf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:32.921553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:32.989386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:33.274714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db78458-0d30-435d-87bd-4ff15461f11b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:33.276289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7db78458-0d30-435d-87bd-4ff15461f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:33.380310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db78458-0d30-435d-87bd-4ff15461f11b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:33.408533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:33.454092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:33.454701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:33.454985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:33.455260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:33.457965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:33.568211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:33.569681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1838e9-af4d-4254-bbac-e8213d20c958 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:33.588753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 740/1458] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:35.540599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d082-8bcc-4efc-93d7-9f0316129ab5 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:35.541155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d082-8bcc-4efc-93d7-9f0316129ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:35.541155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0d082-8bcc-4efc-93d7-9f0316129ab5 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:35.542544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:35.547837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f697ff-30c1-45d7-9bae-ec419b8aa551 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:35.548268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f697ff-30c1-45d7-9bae-ec419b8aa551 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:35.548365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f697ff-30c1-45d7-9bae-ec419b8aa551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:35.615190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b6f697ff-30c1-45d7-9bae-ec419b8aa551 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:35.616380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6f697ff-30c1-45d7-9bae-ec419b8aa551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:35.624811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:35.713400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:35.998806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d082-8bcc-4efc-93d7-9f0316129ab5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:36.000333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-23e0d082-8bcc-4efc-93d7-9f0316129ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:36.104932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0d082-8bcc-4efc-93d7-9f0316129ab5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:36.159356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:36.178207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:36.178807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:36.179082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:36.179353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:36.180924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:36.289738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:36.291182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7befbe-94e2-48a5-a3fa-401eced9ce15 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:36.308976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 720/1461] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:38.343090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddf881-19c8-4bcd-8f49-1af6848a7d38 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:38.343661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddf881-19c8-4bcd-8f49-1af6848a7d38 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:38.343661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddf881-19c8-4bcd-8f49-1af6848a7d38 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:38.345009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:38.351266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaeb8e-9ce1-4193-873b-c70b84c3d66a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:38.351719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaeb8e-9ce1-4193-873b-c70b84c3d66a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:38.351827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaeb8e-9ce1-4193-873b-c70b84c3d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:38.418311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5ddaeb8e-9ce1-4193-873b-c70b84c3d66a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:38.419523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5ddaeb8e-9ce1-4193-873b-c70b84c3d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:38.457526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:38.515107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:38.796294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddf881-19c8-4bcd-8f49-1af6848a7d38 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:38.797895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9bddf881-19c8-4bcd-8f49-1af6848a7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:38.899357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddf881-19c8-4bcd-8f49-1af6848a7d38 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:38.936825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:38.971563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:38.972851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:38.973227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:38.973506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:38.975110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:39.091849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:39.093319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d5fb6-f212-4c1c-9cbe-03c47b8033cb service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:39.111345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 743/1464] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:41.136317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd750bc-5455-4406-8cdf-a67f76f636f3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:41.137158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd750bc-5455-4406-8cdf-a67f76f636f3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:41.137444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd750bc-5455-4406-8cdf-a67f76f636f3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:41.138979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:41.145213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb641ae-9a7e-4b5b-bce8-b74922169dc9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:41.145714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb641ae-9a7e-4b5b-bce8-b74922169dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:41.145841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb641ae-9a7e-4b5b-bce8-b74922169dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:41.211052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-eeb641ae-9a7e-4b5b-bce8-b74922169dc9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:41.212241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eeb641ae-9a7e-4b5b-bce8-b74922169dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:41.229766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:41.309758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:41.594836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd750bc-5455-4406-8cdf-a67f76f636f3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:41.596409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6cd750bc-5455-4406-8cdf-a67f76f636f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:41.701296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd750bc-5455-4406-8cdf-a67f76f636f3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:41.767463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:41.775535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:41.776176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:41.776455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:41.776729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:41.778390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:41.891983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:41.893375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70d8c7-fa9a-4f97-a904-a2936a8d78d0 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:41.911724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 723/1467] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:43.854317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47aac1-65a9-4f43-b18e-3488f599bad6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:43.854854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47aac1-65a9-4f43-b18e-3488f599bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:43.854854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47aac1-65a9-4f43-b18e-3488f599bad6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:43.856218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:16:43.861703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1dfe-bc42-4cd3-8244-bbdb73fdd320 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:43.862119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1dfe-bc42-4cd3-8244-bbdb73fdd320 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:43.862253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d1dfe-bc42-4cd3-8244-bbdb73fdd320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:43.928406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ce6d1dfe-bc42-4cd3-8244-bbdb73fdd320 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:16:43.929615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ce6d1dfe-bc42-4cd3-8244-bbdb73fdd320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:43.977455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:44.027002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:16:44.310843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47aac1-65a9-4f43-b18e-3488f599bad6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:16:44.312427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-be47aac1-65a9-4f43-b18e-3488f599bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:44.415420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47aac1-65a9-4f43-b18e-3488f599bad6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:16:44.461377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:44.487571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:16:44.488169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:16:44.488446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:16:44.488713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:16:44.490326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:16:44.598209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:16:44.599573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4cd0b-e901-40bd-9823-31151b924dc7 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:16:44.618347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 746/1470] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:16:54.025173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=22 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:16:54.615574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=66 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:05.123388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984921a-b25a-4486-9f11-7a9fc1572ea4 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:05.123947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984921a-b25a-4486-9f11-7a9fc1572ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:05.123947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984921a-b25a-4486-9f11-7a9fc1572ea4 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:05.125324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 725/1471] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:05.131222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7962b-93b0-4b01-8767-32c5bc398357 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:05.131643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7962b-93b0-4b01-8767-32c5bc398357 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:05.131780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7962b-93b0-4b01-8767-32c5bc398357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:05.197556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-03f7962b-93b0-4b01-8767-32c5bc398357 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:05.198774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-03f7962b-93b0-4b01-8767-32c5bc398357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:05.295486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 747/1472] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:05.590783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3181-1651-44d5-9bad-399ab91b7888 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:05.591067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3181-1651-44d5-9bad-399ab91b7888 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:05.591343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3181-1651-44d5-9bad-399ab91b7888 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:05.592672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 726/1473] 10.222.0.88 () {54 vars in 967 bytes} [Mon Aug 29 23:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:05.597785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646389-1301-4f44-89ca-2baaef08d6ce None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:05.598071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646389-1301-4f44-89ca-2baaef08d6ce None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:05.598348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646389-1301-4f44-89ca-2baaef08d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:05.677394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6a646389-1301-4f44-89ca-2baaef08d6ce None None] MFA Rules not processed for user `016885b1849e4e3d990c3de23c479399`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:05.678599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a646389-1301-4f44-89ca-2baaef08d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:05.699708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:05.755437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 748/1474] 10.222.0.88 () {58 vars in 1064 bytes} [Mon Aug 29 23:17:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:05.763137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3181-1651-44d5-9bad-399ab91b7888 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:05.764693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bfda3181-1651-44d5-9bad-399ab91b7888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:05.868774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3181-1651-44d5-9bad-399ab91b7888 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:05.940423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:05.941295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:05.941562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:05.941829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:05.943405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:05.996513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:06.052672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:06.054143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1a46b-2d67-4bde-828b-b44bdc5e246d service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:06.072235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 727/1475] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:17:08.062735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c881c-9eeb-400c-a1c8-4908285380d8 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:08.063228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c881c-9eeb-400c-a1c8-4908285380d8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:08.063337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c881c-9eeb-400c-a1c8-4908285380d8 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:08.064622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 749/1476] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:08.069971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8d02-c79f-424d-8d56-423f7e3c8959 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:08.070368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8d02-c79f-424d-8d56-423f7e3c8959 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:08.070519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab8d02-c79f-424d-8d56-423f7e3c8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:08.135540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e5ab8d02-c79f-424d-8d56-423f7e3c8959 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:08.136740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e5ab8d02-c79f-424d-8d56-423f7e3c8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:08.233290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 728/1477] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:08.504781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c881c-9eeb-400c-a1c8-4908285380d8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:08.506394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-317c881c-9eeb-400c-a1c8-4908285380d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:08.632838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c881c-9eeb-400c-a1c8-4908285380d8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:08.681253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:08.725735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:08.726342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:08.726620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:08.726892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:08.727526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:08.729279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:17:08.729279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:17:08.729279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:17:08.730407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b7f31-ea08-4cf4-8be8-062c848d4b36 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:08.749046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 750/1478] 10.222.0.88 () {56 vars in 1108 bytes} [Mon Aug 29 23:17:08 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:17:10.663620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc5d34-f9ab-4044-af06-9837bddaad86 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:10.664149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc5d34-f9ab-4044-af06-9837bddaad86 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:10.664149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc5d34-f9ab-4044-af06-9837bddaad86 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:10.665529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 729/1479] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:10.670597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8c98a-0959-478d-b2ec-851768f58a6c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:10.671044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8c98a-0959-478d-b2ec-851768f58a6c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:10.671150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8c98a-0959-478d-b2ec-851768f58a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:10.736881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-97c8c98a-0959-478d-b2ec-851768f58a6c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:10.738626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-97c8c98a-0959-478d-b2ec-851768f58a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:10.834579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 751/1480] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:11.147569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc5d34-f9ab-4044-af06-9837bddaad86 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:11.149088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-97bc5d34-f9ab-4044-af06-9837bddaad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:11.159254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:11.296219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc5d34-f9ab-4044-af06-9837bddaad86 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:11.377179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:11.410643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:11.411251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:11.411528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:11.411802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:11.413426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:11.507371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:11.508983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9960bac-72eb-4f4e-b313-d3f0a859588a service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:11.526475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 730/1481] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:17:13.636232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febfff-9533-4b86-b06e-49f3729baed3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:13.636707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febfff-9533-4b86-b06e-49f3729baed3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:13.636829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31febfff-9533-4b86-b06e-49f3729baed3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:13.638196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 752/1482] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:13.643291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ef06-6d81-48ea-8bbe-756fd615ef75 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:13.643754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ef06-6d81-48ea-8bbe-756fd615ef75 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:13.643948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ef06-6d81-48ea-8bbe-756fd615ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:13.709680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6874ef06-6d81-48ea-8bbe-756fd615ef75 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:13.710832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6874ef06-6d81-48ea-8bbe-756fd615ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:13.756757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:13.807217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 731/1483] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:14.097081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febfff-9533-4b86-b06e-49f3729baed3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:14.098835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-31febfff-9533-4b86-b06e-49f3729baed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:14.122062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:14.201886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31febfff-9533-4b86-b06e-49f3729baed3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:14.274456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:14.275066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:14.275342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:14.275613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:14.277221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:14.350942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:14.387039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:14.388492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368dafc-9f7c-4212-ba59-1ba9f3b966b6 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:14.408294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 753/1484] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:17:16.428539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e189-428c-48e7-9a88-557697521c17 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:16.429046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e189-428c-48e7-9a88-557697521c17 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:16.429046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1e189-428c-48e7-9a88-557697521c17 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:16.430393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 732/1485] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:16.435668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942394-d44d-4000-a80d-1c8555ac6eaf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:16.436068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942394-d44d-4000-a80d-1c8555ac6eaf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:16.436227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942394-d44d-4000-a80d-1c8555ac6eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:16.511432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2e942394-d44d-4000-a80d-1c8555ac6eaf None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:16.512651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2e942394-d44d-4000-a80d-1c8555ac6eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:16.611040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 754/1486] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:16.917233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1e189-428c-48e7-9a88-557697521c17 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:16.918830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-14a1e189-428c-48e7-9a88-557697521c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:17.022525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1e189-428c-48e7-9a88-557697521c17 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:17.096934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:17.098877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:17.099513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:17.099811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:17.100086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:17.102228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:17.210076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:17.211428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b149e83-8496-477c-bccb-3b4449083ce4 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:17.228699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 733/1487] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:17:19.306461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adc22d-2c38-4815-b163-8b2aab8c7572 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:19.307006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adc22d-2c38-4815-b163-8b2aab8c7572 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:19.307006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adc22d-2c38-4815-b163-8b2aab8c7572 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:19.308379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 755/1488] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:19.313897 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e9f2-7c3d-4475-a542-0a2b525ed209 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:19.314301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e9f2-7c3d-4475-a542-0a2b525ed209 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:19.314452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6e9f2-7c3d-4475-a542-0a2b525ed209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:19.380935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9ce6e9f2-7c3d-4475-a542-0a2b525ed209 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:19.382184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9ce6e9f2-7c3d-4475-a542-0a2b525ed209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:19.434303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:19.478232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 734/1489] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:17:19.774034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adc22d-2c38-4815-b163-8b2aab8c7572 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:19.775578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6adc22d-2c38-4815-b163-8b2aab8c7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:19.811394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:19.878840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adc22d-2c38-4815-b163-8b2aab8c7572 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:19.950942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:19.951543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:19.951826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:19.952101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:19.953715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:20.032657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:20.062774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:20.064222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b886f2c-746d-4b54-ba9e-1a1d2d71ea60 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:20.084475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 756/1490] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:17:22.256709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a07e-c99a-48e8-9295-6babbd712365 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:22.257347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a07e-c99a-48e8-9295-6babbd712365 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:22.257347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a07e-c99a-48e8-9295-6babbd712365 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:22.258627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 735/1491] 10.222.0.88 () {54 vars in 927 bytes} [Mon Aug 29 23:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:17:22.263775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aec1a-894e-4854-a6a8-18bd3a775964 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:22.264236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aec1a-894e-4854-a6a8-18bd3a775964 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:22.264348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aec1a-894e-4854-a6a8-18bd3a775964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:22.329974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a52aec1a-894e-4854-a6a8-18bd3a775964 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:17:22.331730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a52aec1a-894e-4854-a6a8-18bd3a775964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:22.427338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 757/1492] 10.222.0.88 () {58 vars in 1024 bytes} [Mon Aug 29 23:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:17:22.714488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a07e-c99a-48e8-9295-6babbd712365 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:17:22.716028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6c07a07e-c99a-48e8-9295-6babbd712365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:22.819229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a07e-c99a-48e8-9295-6babbd712365 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:17:22.890810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:17:22.891339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:17:22.891615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:17:22.891890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:17:22.893621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:17:22.902497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:23.000497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:17:23.001961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdee523-fdf7-44a7-bacf-fb7006b29e20 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:17:23.020929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 736/1493] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:17:32.425644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=82 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:17:33.018101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=50 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:35.597382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:35.597970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:35.597970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:35.675102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:18:35.676313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:35.771846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 758/1494] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:18:35.779935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:35.780428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:35.780530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:35.856193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:18:35.857352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:35.951986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 737/1495] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:18:35.957244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:35.958431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:35.969724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1c49e-04be-4a72-8bec-336aa05720a4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:36.029777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:36.064200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:36.064813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:36.065091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:36.065401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:36.066071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:18:36.066376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:36.067430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:36.067430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:18:36.067430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:18:36.068320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:36.080376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 759/1496] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:18:36.088706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:36.098315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced63584-8e56-4f52-b5d2-49f5d8118cde None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:36.160012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:36.194312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:36.194921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:36.195202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:36.195478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:36.196112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:36.197917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:36.197917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:18:36.197917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:18:36.199130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:36.254437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 738/1497] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:18:36 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:18:36.258885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:36.260460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:36.293880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8222a5-367a-45b9-b9a6-1d2fc7b54870 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:36.397049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:36.397687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:36.397968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:36.398243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:36.398875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:36.399894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:36.399894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:18:36.399894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:18:36.401127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:36.444874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 760/1498] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:18:36 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:18:36.448980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:36.450519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:36.513170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd9c60-dbe4-4bf3-9f75-0dac7ce909c9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:36.597260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:36.608670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:36.609319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:36.609629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:36.609909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:36.610557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:36.611577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:36.611577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:18:36.611577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:18:36.612485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:36.626274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 739/1499] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:18:36.630402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:36.631939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:36.643973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7f17d-470e-42b9-adfe-c54668df4583 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:36.668654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:36.738594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:36.739132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:36.739415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:36.739690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:36.740333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:36.741382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:36.741382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:18:36.741382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:18:36.742274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff67fc-bb51-4a3c-be45-1bf65ac1fa25 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:36.755254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 761/1500] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:18:36.759600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:36.761230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:36.795913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0e70-1ad1-47e5-a95b-7946c6e85ae9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:37.006443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:37.007006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.007281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.007552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] PATH_INFO: `/v3/projects/3543815c46bf4294866b393675d5ee3d/users/f1812b61e8894ea598e2c80296b07f4c/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.028431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3543815c46bf4294866b393675d5ee3d, user_id=f1812b61e8894ea598e2c80296b07f4c, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:37.029487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:37.029487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:18:37.029487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:18:37.031390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83975f16-876b-4c80-82ea-11ee0b3e20be admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:37.056984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 740/1501] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:18:36 2022] PUT /identity/v3/projects/3543815c46bf4294866b393675d5ee3d/users/f1812b61e8894ea598e2c80296b07f4c/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:18:37.070106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82d9e8-4b84-4a20-970a-546120817379 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.070399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82d9e8-4b84-4a20-970a-546120817379 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.070677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82d9e8-4b84-4a20-970a-546120817379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.127358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6a82d9e8-4b84-4a20-970a-546120817379 None None] MFA Rules not processed for user `f1812b61e8894ea598e2c80296b07f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:18:37.128569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a82d9e8-4b84-4a20-970a-546120817379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:37.204774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 762/1502] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:18:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:18:37.217653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e955d-15d3-4ecd-994d-ec06fa0915b6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.218046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e955d-15d3-4ecd-994d-ec06fa0915b6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.218332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e955d-15d3-4ecd-994d-ec06fa0915b6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.220182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 741/1503] 10.222.0.88 () {54 vars in 964 bytes} [Mon Aug 29 23:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:18:37.224977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148391f-856a-4f9e-8553-6518120a8b5d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.225298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148391f-856a-4f9e-8553-6518120a8b5d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.225578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148391f-856a-4f9e-8553-6518120a8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.257050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:37.301739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d148391f-856a-4f9e-8553-6518120a8b5d None None] MFA Rules not processed for user `1cda9da215144c6ca429f8787be283f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:18:37.302955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d148391f-856a-4f9e-8553-6518120a8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:37.377063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 763/1504] 10.222.0.88 () {58 vars in 1061 bytes} [Mon Aug 29 23:18:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:18:37.384772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e955d-15d3-4ecd-994d-ec06fa0915b6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:37.386295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d77e955d-15d3-4ecd-994d-ec06fa0915b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:37.435667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:37.490309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e955d-15d3-4ecd-994d-ec06fa0915b6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:37.565002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:37.565628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.565899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.566162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.567736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:37.664101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:37.665570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:37.668925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:37.684487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 742/1505] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:18:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:18:37.730245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26621-3198-44f0-a16f-0077fcdced40 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.730653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26621-3198-44f0-a16f-0077fcdced40 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.730801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26621-3198-44f0-a16f-0077fcdced40 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.732064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 764/1506] 10.222.0.88 () {52 vars in 830 bytes} [Mon Aug 29 23:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:18:37.736185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:37.737416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:37.836406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcab23-9b94-45bc-b1c7-a582a4c7b4fd service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:37.928555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:37.929206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:37.929487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:37.929754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] PATH_INFO: `/v3/users/f1812b61e8894ea598e2c80296b07f4c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:37.942461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1812b61e8894ea598e2c80296b07f4c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:37.943485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:37.943485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:18:37.943485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:18:37.944673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:37.954423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:38.010432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1812b61e8894ea598e2c80296b07f4c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:38.010982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1812b61e8894ea598e2c80296b07f4c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:38.019674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1812b61e8894ea598e2c80296b07f4c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:38.043546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1812b61e8894ea598e2c80296b07f4c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:38.043996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1812b61e8894ea598e2c80296b07f4c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:38.062553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 743/1507] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:18:37 2022] DELETE /identity/v3/users/f1812b61e8894ea598e2c80296b07f4c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:18:38.067699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:38.067984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:38.068259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:38.127047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:18:38.128258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:38.211755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:38.225114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 765/1508] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:18:38.234913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:38.236133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:38.335298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b805f47-17ef-4ee5-aa4f-041b298595a4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:38.395242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:38.415849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:38.416451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:38.416724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:38.416991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:38.418603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:38.523288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:38.524718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961b5c9-e2a5-4a65-889d-5db4a0dcdf6b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:38.543112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 744/1509] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:18:38.883644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:18:38.885022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:18:38.897404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b773a5a-1533-4fab-99dd-62df154751a4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:18:38.996461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:18:38.997083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:18:38.997387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:18:38.997655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] PATH_INFO: `/v3/projects/3543815c46bf4294866b393675d5ee3d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:18:39.007866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3543815c46bf4294866b393675d5ee3d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:18:39.008886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:18:39.008886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:18:39.008886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:18:39.010106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:18:39.067249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3543815c46bf4294866b393675d5ee3d', 'request_id': 'req-b277db0a-a7c4-40e2-9cb6-b23ca547793a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:39.073172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3543815c46bf4294866b393675d5ee3d', 'request_id': 'req-b277db0a-a7c4-40e2-9cb6-b23ca547793a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:39.082770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3543815c46bf4294866b393675d5ee3d', 'request_id': 'req-b277db0a-a7c4-40e2-9cb6-b23ca547793a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:39.112293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] The token cache is being invalidate because project 3543815c46bf4294866b393675d5ee3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:18:39.112591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:39.113132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b277db0a-a7c4-40e2-9cb6-b23ca547793a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:18:39.114457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 766/1510] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:18:38 2022] DELETE /identity/v3/projects/3543815c46bf4294866b393675d5ee3d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:18:48.540867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=62 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:18:49.110110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:23.406941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b88471-251a-4631-95d2-253f456656fe None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:23.407844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b88471-251a-4631-95d2-253f456656fe None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:23.407844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b88471-251a-4631-95d2-253f456656fe None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:23.409082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:23.413845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b7235-3c16-40ad-8b2a-849a44ff5814 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:23.414256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b7235-3c16-40ad-8b2a-849a44ff5814 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:23.414455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b7235-3c16-40ad-8b2a-849a44ff5814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:23.494561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-726b7235-3c16-40ad-8b2a-849a44ff5814 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:23.495808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-726b7235-3c16-40ad-8b2a-849a44ff5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:23.601856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:23.755817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b88471-251a-4631-95d2-253f456656fe None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:23.757939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-70b88471-251a-4631-95d2-253f456656fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:23.875846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b88471-251a-4631-95d2-253f456656fe None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:23.881322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2542c0-8390-416c-a23f-d07b14c7fc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:23.881926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2542c0-8390-416c-a23f-d07b14c7fc4e service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:23.882207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2542c0-8390-416c-a23f-d07b14c7fc4e service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:23.882487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2542c0-8390-416c-a23f-d07b14c7fc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:23.890941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2542c0-8390-416c-a23f-d07b14c7fc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:23.892529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2542c0-8390-416c-a23f-d07b14c7fc4e service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:23.901680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 746/1513] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:24.738860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead18e2f-dd35-4095-b763-086a02d2ba9b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:24.739436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead18e2f-dd35-4095-b763-086a02d2ba9b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:24.739436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead18e2f-dd35-4095-b763-086a02d2ba9b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:24.740751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:24.745627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c776e-d6fb-412f-9004-0e6923053f67 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:24.746028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c776e-d6fb-412f-9004-0e6923053f67 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:24.746176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c776e-d6fb-412f-9004-0e6923053f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:24.765765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-001c776e-d6fb-412f-9004-0e6923053f67 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:24.766980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-001c776e-d6fb-412f-9004-0e6923053f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:24.774700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:24.926114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead18e2f-dd35-4095-b763-086a02d2ba9b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:24.940034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead18e2f-dd35-4095-b763-086a02d2ba9b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:24.945382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687bc8-3de1-44f2-8475-c58d7b7da383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:24.945975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687bc8-3de1-44f2-8475-c58d7b7da383 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:24.946254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687bc8-3de1-44f2-8475-c58d7b7da383 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:24.946525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687bc8-3de1-44f2-8475-c58d7b7da383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:24.954931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8687bc8-3de1-44f2-8475-c58d7b7da383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:24.956512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8687bc8-3de1-44f2-8475-c58d7b7da383 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:24.965654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 769/1516] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:27.294086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac861ab-ff00-440c-aaa3-a40e23581403 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:27.294719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac861ab-ff00-440c-aaa3-a40e23581403 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:27.294822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac861ab-ff00-440c-aaa3-a40e23581403 None None] PATH_INFO: `/v3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:27.296056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 748/1517] 10.222.0.86 () {54 vars in 925 bytes} [Mon Aug 29 23:20:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:20:27.302641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b2c0-26f6-4113-8b30-296b146e04c2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:27.303059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b2c0-26f6-4113-8b30-296b146e04c2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:27.303208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b2c0-26f6-4113-8b30-296b146e04c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:27.362207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b0d9b2c0-26f6-4113-8b30-296b146e04c2 None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:27.363618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0d9b2c0-26f6-4113-8b30-296b146e04c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:27.380126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:27.436722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 770/1518] 10.222.0.86 () {58 vars in 1015 bytes} [Mon Aug 29 23:20:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:20:31.897887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c946a-9b19-4bf4-842b-d2398f3569c2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:31.898442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c946a-9b19-4bf4-842b-d2398f3569c2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:31.898442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c946a-9b19-4bf4-842b-d2398f3569c2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:31.899667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 749/1519] 10.222.0.88 () {54 vars in 961 bytes} [Mon Aug 29 23:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:31.904833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3066-4f9c-4571-94aa-f4e42ac4e3ec None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:31.905285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3066-4f9c-4571-94aa-f4e42ac4e3ec None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:31.905473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3066-4f9c-4571-94aa-f4e42ac4e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:31.925924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-150c3066-4f9c-4571-94aa-f4e42ac4e3ec None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:31.927104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-150c3066-4f9c-4571-94aa-f4e42ac4e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:31.936038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 771/1520] 10.222.0.88 () {58 vars in 1058 bytes} [Mon Aug 29 23:20:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:31.943291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c946a-9b19-4bf4-842b-d2398f3569c2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:31.956385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c946a-9b19-4bf4-842b-d2398f3569c2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:31.961214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dc7f5-e4b8-4591-aab0-532cc16877e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:31.961796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc7f5-e4b8-4591-aab0-532cc16877e6 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:31.962073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc7f5-e4b8-4591-aab0-532cc16877e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:31.962345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dc7f5-e4b8-4591-aab0-532cc16877e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:31.971092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dc7f5-e4b8-4591-aab0-532cc16877e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:31.972650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dc7f5-e4b8-4591-aab0-532cc16877e6 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:31.982601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 750/1521] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:36.284861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71e76-6680-4126-baa4-234c268cb24f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:36.285417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71e76-6680-4126-baa4-234c268cb24f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:36.285417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc71e76-6680-4126-baa4-234c268cb24f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:36.286790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:36.291556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d66e2a-67cd-4959-8e94-04d4be5ce368 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:36.291967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d66e2a-67cd-4959-8e94-04d4be5ce368 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:36.292079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d66e2a-67cd-4959-8e94-04d4be5ce368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:36.311595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-94d66e2a-67cd-4959-8e94-04d4be5ce368 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:36.312779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-94d66e2a-67cd-4959-8e94-04d4be5ce368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:36.320805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:36.476225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71e76-6680-4126-baa4-234c268cb24f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:36.491044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc71e76-6680-4126-baa4-234c268cb24f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:36.496328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29f8c8-683a-44a3-a812-855907364f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:36.497662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29f8c8-683a-44a3-a812-855907364f1a service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:36.497895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29f8c8-683a-44a3-a812-855907364f1a service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:36.498168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29f8c8-683a-44a3-a812-855907364f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:36.505977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29f8c8-683a-44a3-a812-855907364f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:36.507559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29f8c8-683a-44a3-a812-855907364f1a service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:36.517470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 773/1524] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:37.339119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3726a-c493-4caa-800e-35bdb136840d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:37.339704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3726a-c493-4caa-800e-35bdb136840d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:37.339704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3726a-c493-4caa-800e-35bdb136840d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:37.341240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:37.346110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80005-69bb-47d4-ad38-55ef7698be65 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:37.346519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80005-69bb-47d4-ad38-55ef7698be65 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:37.346659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f80005-69bb-47d4-ad38-55ef7698be65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:37.365735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-57f80005-69bb-47d4-ad38-55ef7698be65 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:37.366925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-57f80005-69bb-47d4-ad38-55ef7698be65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:37.375178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:37.529793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3726a-c493-4caa-800e-35bdb136840d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:37.544726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3726a-c493-4caa-800e-35bdb136840d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:37.550122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2beb44d-4ce0-4f83-bfda-41bcdb04cc0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:37.550712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb44d-4ce0-4f83-bfda-41bcdb04cc0f service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:37.550992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb44d-4ce0-4f83-bfda-41bcdb04cc0f service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:37.551264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2beb44d-4ce0-4f83-bfda-41bcdb04cc0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:37.559930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb44d-4ce0-4f83-bfda-41bcdb04cc0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:37.561534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2beb44d-4ce0-4f83-bfda-41bcdb04cc0f service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:37.570592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 753/1527] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:41.474023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a445-e383-4930-adb2-497ed4f1815a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:41.474553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a445-e383-4930-adb2-497ed4f1815a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:41.474553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a445-e383-4930-adb2-497ed4f1815a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:41.475881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:41.481852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbddd0f-cfb9-4076-9856-1f2e2103a4f1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:41.482325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbddd0f-cfb9-4076-9856-1f2e2103a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:41.482429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbddd0f-cfb9-4076-9856-1f2e2103a4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:41.502481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1fbddd0f-cfb9-4076-9856-1f2e2103a4f1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:41.503664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1fbddd0f-cfb9-4076-9856-1f2e2103a4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:41.511381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:41.809633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44a445-e383-4930-adb2-497ed4f1815a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:41.811376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aa44a445-e383-4930-adb2-497ed4f1815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:41.889032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44a445-e383-4930-adb2-497ed4f1815a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:41.892629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505fd51-bcaf-414d-a20f-d87e99ad290e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:41.893268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fd51-bcaf-414d-a20f-d87e99ad290e service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:41.893553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fd51-bcaf-414d-a20f-d87e99ad290e service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:41.893827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505fd51-bcaf-414d-a20f-d87e99ad290e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:41.902536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505fd51-bcaf-414d-a20f-d87e99ad290e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:41.904657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505fd51-bcaf-414d-a20f-d87e99ad290e service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:41.914361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 776/1530] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:43.834927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fe5be-cfd6-4e52-b61c-d59dd96ae42f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:43.835483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fe5be-cfd6-4e52-b61c-d59dd96ae42f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:43.835597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fe5be-cfd6-4e52-b61c-d59dd96ae42f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:43.836942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:43.842786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e119f-78e1-49ff-9a19-61642be25639 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:43.843222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e119f-78e1-49ff-9a19-61642be25639 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:43.843322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e119f-78e1-49ff-9a19-61642be25639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:43.862440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5d0e119f-78e1-49ff-9a19-61642be25639 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:43.863617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5d0e119f-78e1-49ff-9a19-61642be25639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:43.871172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:44.152420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fe5be-cfd6-4e52-b61c-d59dd96ae42f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:44.163889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fe5be-cfd6-4e52-b61c-d59dd96ae42f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:44.167468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e16a5-e0cb-4900-b338-51b46b4d86ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:44.168066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e16a5-e0cb-4900-b338-51b46b4d86ea service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:44.168973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e16a5-e0cb-4900-b338-51b46b4d86ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:44.169483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e16a5-e0cb-4900-b338-51b46b4d86ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:44.178334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e16a5-e0cb-4900-b338-51b46b4d86ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:44.179761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e16a5-e0cb-4900-b338-51b46b4d86ea service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:44.189229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 756/1533] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:48.103876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dc746-8373-45e8-a48c-4a874616d603 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:48.104439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dc746-8373-45e8-a48c-4a874616d603 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:48.104439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dc746-8373-45e8-a48c-4a874616d603 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:48.106401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:48.111804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31ecf3-9766-4f6f-998a-97c69c3c4472 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:48.112204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31ecf3-9766-4f6f-998a-97c69c3c4472 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:48.112356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31ecf3-9766-4f6f-998a-97c69c3c4472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:48.132524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-de31ecf3-9766-4f6f-998a-97c69c3c4472 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:48.133737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de31ecf3-9766-4f6f-998a-97c69c3c4472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:48.141526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:48.702209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dc746-8373-45e8-a48c-4a874616d603 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:48.703887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb5dc746-8373-45e8-a48c-4a874616d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:48.769082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:48.783415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dc746-8373-45e8-a48c-4a874616d603 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:48.787010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3e0ac-684d-4a26-8bd2-98744bf4593a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:48.787615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3e0ac-684d-4a26-8bd2-98744bf4593a service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:48.787894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3e0ac-684d-4a26-8bd2-98744bf4593a service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:48.788170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3e0ac-684d-4a26-8bd2-98744bf4593a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:48.796979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3e0ac-684d-4a26-8bd2-98744bf4593a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:48.798446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3e0ac-684d-4a26-8bd2-98744bf4593a service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:48.807639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 779/1536] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:20:50.753487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665a5f-19bc-462e-a06f-23c45214e592 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:50.754039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665a5f-19bc-462e-a06f-23c45214e592 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:50.754039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c665a5f-19bc-462e-a06f-23c45214e592 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:50.755359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:20:50.760502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021868-7d97-4e91-950a-ca42fa9ff652 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:50.760949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021868-7d97-4e91-950a-ca42fa9ff652 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:50.761057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b021868-7d97-4e91-950a-ca42fa9ff652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:50.781939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8b021868-7d97-4e91-950a-ca42fa9ff652 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:20:50.783381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8b021868-7d97-4e91-950a-ca42fa9ff652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:50.791118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:20:51.347863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665a5f-19bc-462e-a06f-23c45214e592 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:20:51.349540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c665a5f-19bc-462e-a06f-23c45214e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:20:51.357028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=84 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:20:51.363510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c665a5f-19bc-462e-a06f-23c45214e592 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:20:51.367109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ac3c8-9e8b-4917-8ec0-6959f41461a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:20:51.367712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac3c8-9e8b-4917-8ec0-6959f41461a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:20:51.367993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac3c8-9e8b-4917-8ec0-6959f41461a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:20:51.368268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ac3c8-9e8b-4917-8ec0-6959f41461a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:20:51.377264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac3c8-9e8b-4917-8ec0-6959f41461a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:20:51.378686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ac3c8-9e8b-4917-8ec0-6959f41461a8 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:20:51.388349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 759/1539] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:21:00.776954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=11 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:21:01.383769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:22.642773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.649931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.649931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.672170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:22.673880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:22.687804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 781/1540] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:22.698426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce3057-7476-4424-8c17-dc4d49a68495 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.699617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce3057-7476-4424-8c17-dc4d49a68495 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.700192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce3057-7476-4424-8c17-dc4d49a68495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.731541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e4ce3057-7476-4424-8c17-dc4d49a68495 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:22.733330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e4ce3057-7476-4424-8c17-dc4d49a68495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:22.746635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 760/1541] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:22.752545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:22.757861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a3174-4c01-41dd-9769-690770201166 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.758519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a3174-4c01-41dd-9769-690770201166 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.759034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a3174-4c01-41dd-9769-690770201166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.772168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0630-cfc0-47ea-9522-bb7056dbc316 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:22.790029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:22.790029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.790029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.790029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.791507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:22.791714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:22.793935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:22.794817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d41a3174-4c01-41dd-9769-690770201166 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:22.797175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d41a3174-4c01-41dd-9769-690770201166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:22.821448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 761/1542] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:22.824641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 782/1543] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:22:22.831428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.832044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.832567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.832931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:22.861891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740fd78-1cdb-491d-a197-3df2282faa43 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:22.870701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:22.871318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:22.872144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.872655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.872940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.873371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:22.873627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:22.874664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:22:22.874664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:22:22.874664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:22:22.876001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de53c0-0438-42ea-9fe5-1f6fd51c8828 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:22.893300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 762/1544] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:22.903520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:22.919639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31e7b5-d560-470c-8d1b-6f7ab836c30a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:22.929792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:22.931140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.931645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.932150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.933051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:22.933630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:22.934895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:22:22.934895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:22:22.934895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:22:22.941313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0f7a3-4742-4592-b714-365966eab981 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:22.966782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 763/1545] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:22.968480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.969018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.969594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:22.977213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 783/1546] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:22.977213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:22.977213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:22.977602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.021656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.022881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.023834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.025037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.144012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 784/1547] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.144687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.148049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 764/1548] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.153302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.161232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f916ac9-b1d7-433b-a36e-de48d1680de8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.164250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5629cc-5be0-4cd6-b084-288f104b55f9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.167595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e76fb4-78a7-4db3-9eaf-f0df45836d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.168689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e76fb4-78a7-4db3-9eaf-f0df45836d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.169252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e76fb4-78a7-4db3-9eaf-f0df45836d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.169683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e76fb4-78a7-4db3-9eaf-f0df45836d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.170416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e76fb4-78a7-4db3-9eaf-f0df45836d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.171211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.171904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.172259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.172446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e76fb4-78a7-4db3-9eaf-f0df45836d12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.172612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.173408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.174496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:22:23.174496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:22:23.174496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:22:23.175802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f522b-6de1-460a-92c9-5ca595be8c1d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.199559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 765/1549] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.200934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780e900-dd58-46b7-9b57-e06c00773858 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.201278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780e900-dd58-46b7-9b57-e06c00773858 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.201587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780e900-dd58-46b7-9b57-e06c00773858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.215031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 785/1550] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.216494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fbd67-5af9-44b3-9546-d592fcfdf352 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.217011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fbd67-5af9-44b3-9546-d592fcfdf352 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.217424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fbd67-5af9-44b3-9546-d592fcfdf352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.230190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d780e900-dd58-46b7-9b57-e06c00773858 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.231455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d780e900-dd58-46b7-9b57-e06c00773858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.244053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-513fbd67-5af9-44b3-9546-d592fcfdf352 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.245595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-513fbd67-5af9-44b3-9546-d592fcfdf352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.292572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 766/1551] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.293886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef589-42af-44a3-8275-ecaff85b12d3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.294171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef589-42af-44a3-8275-ecaff85b12d3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.294443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cef589-42af-44a3-8275-ecaff85b12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.316531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-94cef589-42af-44a3-8275-ecaff85b12d3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.318548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-94cef589-42af-44a3-8275-ecaff85b12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.319770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 786/1552] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.329049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.329367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.329648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.329758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 767/1553] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.331076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.331375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.331656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.355316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.356599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.358061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.359298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.368139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 768/1554] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.369170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.369606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 787/1555] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.370481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.382740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d990-ce8c-4b3e-825d-93825e5ef3bd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.382985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d1f8c-83e2-4a55-8fa2-8183f5a0951b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.388252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30b11-726b-4159-97af-52c997e1ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.388627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2c5dc-9482-4eaf-9bda-40ff02ffb6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.388869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30b11-726b-4159-97af-52c997e1ad4c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.389186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30b11-726b-4159-97af-52c997e1ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.389337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2c5dc-9482-4eaf-9bda-40ff02ffb6db admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.389502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30b11-726b-4159-97af-52c997e1ad4c admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.389669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2c5dc-9482-4eaf-9bda-40ff02ffb6db admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.389830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2c5dc-9482-4eaf-9bda-40ff02ffb6db admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.390093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30b11-726b-4159-97af-52c997e1ad4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.390420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2c5dc-9482-4eaf-9bda-40ff02ffb6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.392055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2c5dc-9482-4eaf-9bda-40ff02ffb6db admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.392235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30b11-726b-4159-97af-52c997e1ad4c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.404409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 769/1556] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:23.405861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e981-365a-4cf8-a8c5-6c5c4474170d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.406227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e981-365a-4cf8-a8c5-6c5c4474170d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.406568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30e981-365a-4cf8-a8c5-6c5c4474170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.422059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 788/1557] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.423314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c51d2-82bd-48f4-811a-5689f83c8a33 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.423642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c51d2-82bd-48f4-811a-5689f83c8a33 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.423916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c51d2-82bd-48f4-811a-5689f83c8a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.431801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7e30e981-365a-4cf8-a8c5-6c5c4474170d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.433010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7e30e981-365a-4cf8-a8c5-6c5c4474170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.436146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:23.442537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 770/1558] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.444342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.444670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.445011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.454229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5d6c51d2-82bd-48f4-811a-5689f83c8a33 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.456416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5d6c51d2-82bd-48f4-811a-5689f83c8a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.466843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.470880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 789/1559] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.471057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.471168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.471168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.471168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.478202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 771/1560] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.480257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.490057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.490307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be24bc-a51a-42b1-9708-edebfd775729 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.491287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.494900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.495504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.495782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.496055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.496742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:23.497044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.498671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.499242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 790/1561] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.500168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.507648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:23.509871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf716f9-3ecd-4ee0-86f2-e65fe9682a9c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.512316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 772/1562] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:23.513159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.520162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.520773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.521051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.521365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.522014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:23.522313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.523933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.527954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70affe3a-e864-49eb-b085-0a3e3544f874 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.532537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caadfb-9987-4a16-b1c8-f546c03d656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.533166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caadfb-9987-4a16-b1c8-f546c03d656e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.533452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caadfb-9987-4a16-b1c8-f546c03d656e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.534109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caadfb-9987-4a16-b1c8-f546c03d656e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.534761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caadfb-9987-4a16-b1c8-f546c03d656e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.536399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caadfb-9987-4a16-b1c8-f546c03d656e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.544031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 791/1563] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:23.544031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.547371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae1302-aa15-4692-9cf2-9bf35c09b535 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.552610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.553258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.553538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.553813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.554511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 773/1564] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:23.554624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.555604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.555891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.556150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.556260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.569395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 792/1565] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:23.570222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.576103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:23.577329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:23.580707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4ea33-0179-4e09-a555-210a68b8d457 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.585259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 774/1566] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:23.585398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.585929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.586024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.586216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.586496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.587122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:23.588176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.590013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.599113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f56ee-60a9-4e8e-abec-3429a07e9079 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.604038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.604640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.611973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 793/1567] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:23.612102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.612102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.612302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.612394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:23.612394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.612394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.615441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baccae-359f-41fa-a44f-dc4d14b1815c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.620222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 775/1568] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:23.620355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.620956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.621268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.621538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.621950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.622179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:23.622481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.624062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.632365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268059f-17d1-4a0c-83b5-41f5332fd56b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.638226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 794/1569] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:23.639241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.640278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.640751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.641250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.642081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.642385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.646221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.653181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12018-a928-4229-82c9-d28bf7587e46 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.657918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.658462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.659027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.659303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.659932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.661879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.675587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 776/1570] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.676522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.698027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 795/1571] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.698027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.741512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a4ef6-a036-4abe-80c9-745361c77a81 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.759882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ee5ad-40f2-43ef-8562-e02f5dfdd7ae admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.764856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.765507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.765789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.766063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.766710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.768468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.779052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 796/1572] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:23.779877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.789987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1488c5-616a-4019-9ba7-4fb04f4a7d55 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.795409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.796008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.796290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.796569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.797312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:23.797616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.799211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.803810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.804478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.804747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.805018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] PATH_INFO: `/v3/projects/1be4743d20cb4c39b4d549d23cdbd7d6/users/45416134d3204770a6ddc7f61538fc3c/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.811255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 797/1573] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:23.812054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.820621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be4743d20cb4c39b4d549d23cdbd7d6, user_id=45416134d3204770a6ddc7f61538fc3c, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.823585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449844-c824-4944-844e-0f0a94d3e393 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.823734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.828417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.829090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.829452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.829742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.830535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.832614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.838765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 777/1574] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:23 2022] PUT /identity/v3/projects/1be4743d20cb4c39b4d549d23cdbd7d6/users/45416134d3204770a6ddc7f61538fc3c/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:23.839644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.865738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 798/1575] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.865738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.882709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:23.906313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:23.906732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60636859-c33e-46b0-a7ef-ea9cc7cae435 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.926723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3cdf3-747c-44f2-b790-2523ac69f7ad admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:23.931445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.932169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.932457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.932732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.933446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.935410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.967548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 799/1576] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.967548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:23.967867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:23.967867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:23.967867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:23.967867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:23.968244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:23.969235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:23.996901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 778/1577] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:23.997955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.033179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408202-adde-4dc9-a855-a43b691c972b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.058980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0ccba-b567-4498-a19a-6736df646770 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.063695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.064304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.064588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.064861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.065521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.067495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.089786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 779/1578] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.090678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.092945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.093611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.093898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.094297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.094936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.096907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.099999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8890b-cb57-4c1c-81e3-e7ac7e8de68f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.104913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd174e3-4853-47ce-bd13-fc6aaf882bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.105732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd174e3-4853-47ce-bd13-fc6aaf882bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.106092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd174e3-4853-47ce-bd13-fc6aaf882bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.106445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd174e3-4853-47ce-bd13-fc6aaf882bfc admin admin] PATH_INFO: `/v3/projects/83734562e27946119f6f398fb504b83a/users/35810d5e373e4ee3ad0f991bb8357eda/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.119170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 800/1579] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:23 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.120165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.123099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd174e3-4853-47ce-bd13-fc6aaf882bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83734562e27946119f6f398fb504b83a, user_id=35810d5e373e4ee3ad0f991bb8357eda, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.126077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd174e3-4853-47ce-bd13-fc6aaf882bfc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.130136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3de01-7a93-4036-ae04-8a6319baade6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.135711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.136305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.136582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.136853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.137508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.139390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 780/1580] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:24 2022] PUT /identity/v3/projects/83734562e27946119f6f398fb504b83a/users/35810d5e373e4ee3ad0f991bb8357eda/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:24.139533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.151415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.151708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.151981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.169188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 801/1581] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.170390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.171500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:24.172864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:24.203202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:24.213583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:24.233509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1a83b-7475-43ed-a0b8-bfd0ed89366f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.236341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 781/1582] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:24.236974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.238367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.238973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.239353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.239636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.240494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.242426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.246082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be21d-4816-49ef-9470-e76479bef43b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.250778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.251563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.252320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.252605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.253656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.256008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.264708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 802/1583] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.265871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.276104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354010b-65d0-4ec9-bcaf-199b9f78e4b3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.282988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 782/1584] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.283154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.283281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.283387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.283387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.283387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.283387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.284912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.291021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08735f-b2c8-418c-a128-a31ab32ccfe3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.295737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5c39b-1913-4bda-9949-256829e25ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.296365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c39b-1913-4bda-9949-256829e25ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.296664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c39b-1913-4bda-9949-256829e25ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.297008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c39b-1913-4bda-9949-256829e25ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.297631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5c39b-1913-4bda-9949-256829e25ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.299331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5c39b-1913-4bda-9949-256829e25ccc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.306560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 803/1585] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.307721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.310190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 783/1586] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.311283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.311560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.311953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.317776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6709838-0db3-418f-a968-23b97af46c1b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.323109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.323741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.324025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.324303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.325468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.326638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.338119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 804/1587] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.339133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.340849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] MFA Rules not processed for user `35810d5e373e4ee3ad0f991bb8357eda`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:24.342069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:24.349772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5f2b-5cb9-44d4-9517-f59cc552d243 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.354434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.355011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.355286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.355555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.356174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.358144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.381925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 805/1588] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/users => generated 291 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:24.381925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.410506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 784/1589] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:24.411448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.424670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ad0ad-3770-4e40-91d4-972cf0268226 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.430380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.430646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.430847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.431668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.432505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.433937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.441561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a1170-d23b-4199-884e-01b319a6a2b5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.447902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 785/1590] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.447902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.450900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.451697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.452074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.452486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.459515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad37e4-61f2-4104-9768-793195d68d96 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.462703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.464163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.464294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.464869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.465316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.465669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.466393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.468021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.473742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 806/1591] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:24.474374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.478300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 786/1592] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.479187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.484576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437f3d-6df8-41d6-b98d-6bd3f479e808 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.489019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148ad63-a9f5-4310-9dd7-9a1d58b82e1c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.491854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.492464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.492743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.493009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.493472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.494213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.494619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.494904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.495170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.495785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.495887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.497524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.509219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 807/1593] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.510415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.511274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 787/1594] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.512595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.520785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e09fd-7670-42b1-9665-92ac60806244 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.524054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79cac5-b7b9-4711-8210-8ba1c44cfe2c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.526402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a24ab-72b8-45d5-a7f3-78138fc4f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.527059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a24ab-72b8-45d5-a7f3-78138fc4f2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.527356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a24ab-72b8-45d5-a7f3-78138fc4f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.527732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a24ab-72b8-45d5-a7f3-78138fc4f2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.528387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a24ab-72b8-45d5-a7f3-78138fc4f2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.530152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.530279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a24ab-72b8-45d5-a7f3-78138fc4f2c9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.530956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.531301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.531784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.532860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.534784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.541837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 808/1595] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.543101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a2f12-5f87-4d85-ab3c-e15ceb8e0fb5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.543383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a2f12-5f87-4d85-ab3c-e15ceb8e0fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.543655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a2f12-5f87-4d85-ab3c-e15ceb8e0fb5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.544872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 809/1596] 10.222.0.88 () {54 vars in 962 bytes} [Mon Aug 29 23:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:22:24.545602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a2f12-5f87-4d85-ab3c-e15ceb8e0fb5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.550133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 788/1597] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.551217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.562225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717f916-3ee4-48ba-ae35-1e3fea5307c9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.562423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a2f12-5f87-4d85-ab3c-e15ceb8e0fb5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.567362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.568085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.568386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.569326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.570101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.571804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.572024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.573737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.574621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.574905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.576176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.578688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.584041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 789/1598] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.584762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.592798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 810/1599] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.594087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.600402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f6cde-36b7-4f9b-9bf9-fe68d324b59a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.605596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb2b3b-3ebd-470d-9607-bf4b4553e7a2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.607344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.607962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.608231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.608560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.609362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.610482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.611010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.611124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.611391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.612083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] PATH_INFO: `/v3/projects/4446226b91c84390ad55d5366e4b5eca/users/f78dfe819ddb47928a9c37ca768147aa/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.628044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4446226b91c84390ad55d5366e4b5eca, user_id=f78dfe819ddb47928a9c37ca768147aa, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.628925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 790/1600] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.629388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:22:24.629388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:22:24.629388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:22:24.631821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79e99d-6fc8-498a-9d4e-fd0d7274c933 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.633448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.645727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fccf0-9ba8-4f69-95d0-d0e247c263d5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.645998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 811/1601] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:24 2022] PUT /identity/v3/projects/4446226b91c84390ad55d5366e4b5eca/users/f78dfe819ddb47928a9c37ca768147aa/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:24.648017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.648017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.648017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.688625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:24.701255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:24.702697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:24.714039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:24.729670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.730664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.730791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.731171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] PATH_INFO: `/v3/projects/dc4615a7eb114145b7da60a0da6635a5/users/5b0fa1f043f549388dd32f85122f2a56/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.747569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4615a7eb114145b7da60a0da6635a5, user_id=5b0fa1f043f549388dd32f85122f2a56, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.750485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.776666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 791/1602] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:24 2022] PUT /identity/v3/projects/dc4615a7eb114145b7da60a0da6635a5/users/5b0fa1f043f549388dd32f85122f2a56/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:24.776666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.802009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 812/1603] 10.222.0.88 () {58 vars in 1059 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:24.802009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.827840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde31e8-af3e-4c96-a4e0-1f43a1781560 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.839303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8adaf7-acfd-4376-961f-e804919301df admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.845599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.846300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.846658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.847044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.847774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.849610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.873145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 792/1604] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:24.874646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.884840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca796133-2408-4df4-b2c3-ede4ca6b641d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:24.889955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.891222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.891654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.891941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] PATH_INFO: `/v3/projects/8db22cc5f6574330a6b27b36a3344248/users/642764a1a825436bb4912e33f2cb4135/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.904321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e35c2-0b0d-4735-88bb-e7a5d996a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:24.905364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e35c2-0b0d-4735-88bb-e7a5d996a30a admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.905964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e35c2-0b0d-4735-88bb-e7a5d996a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.906608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e35c2-0b0d-4735-88bb-e7a5d996a30a admin admin] PATH_INFO: `/v3/projects/396486227d8442bb93d95cce32aeee6d/users/55c184b749004ac298bb634bc948c537/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.912882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db22cc5f6574330a6b27b36a3344248, user_id=642764a1a825436bb4912e33f2cb4135, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.916168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.927560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e35c2-0b0d-4735-88bb-e7a5d996a30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=396486227d8442bb93d95cce32aeee6d, user_id=55c184b749004ac298bb634bc948c537, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:24.930871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e35c2-0b0d-4735-88bb-e7a5d996a30a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:24.936291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 793/1605] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:24 2022] PUT /identity/v3/projects/8db22cc5f6574330a6b27b36a3344248/users/642764a1a825436bb4912e33f2cb4135/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:24.937450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:24.951758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 813/1606] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:24 2022] PUT /identity/v3/projects/396486227d8442bb93d95cce32aeee6d/users/55c184b749004ac298bb634bc948c537/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:24.955490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9304-a5f3-4910-8267-89571cec126d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:24.955490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9304-a5f3-4910-8267-89571cec126d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:24.955490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f9304-a5f3-4910-8267-89571cec126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:24.973853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2c0f9304-a5f3-4910-8267-89571cec126d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:24.974973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2c0f9304-a5f3-4910-8267-89571cec126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.013098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe37556-7efe-4fa3-bd80-5fe75b0ded9f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.043288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 814/1607] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:25.047579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.047873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.048146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.049351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:25.081676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.081832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] MFA Rules not processed for user `5b0fa1f043f549388dd32f85122f2a56`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:25.082488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.082832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.082979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.083230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] PATH_INFO: `/v3/projects/c8f60d918f794e3bb336f376f5ca6a62/users/d137c134f30a4dfb8a47afd5579babcc/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.104246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f60d918f794e3bb336f376f5ca6a62, user_id=d137c134f30a4dfb8a47afd5579babcc, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.107063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:25.107219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.122481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 794/1608] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:24 2022] PUT /identity/v3/projects/c8f60d918f794e3bb336f376f5ca6a62/users/d137c134f30a4dfb8a47afd5579babcc/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:25.129388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.173549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 815/1609] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:25.177888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.190861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff78f-8dfb-4cd9-9122-0d211e2549e1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.229291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fe1e4-00ed-4c74-ba9f-aebcfe77dc4b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.238101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034bf7f-53c0-4f2a-9f52-d86ca96e6958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.238820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bf7f-53c0-4f2a-9f52-d86ca96e6958 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.239168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bf7f-53c0-4f2a-9f52-d86ca96e6958 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.239513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bf7f-53c0-4f2a-9f52-d86ca96e6958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.284228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e444316-c266-40ea-8ff9-796867029acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.286426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444316-c266-40ea-8ff9-796867029acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.286912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444316-c266-40ea-8ff9-796867029acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.287356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e444316-c266-40ea-8ff9-796867029acd admin admin] PATH_INFO: `/v3/projects/0d5c124d1676439281367463aa3f2850/users/4cc14630ede646698bb19f803e9952ad/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.308863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e444316-c266-40ea-8ff9-796867029acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5c124d1676439281367463aa3f2850, user_id=4cc14630ede646698bb19f803e9952ad, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.312275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e444316-c266-40ea-8ff9-796867029acd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.317480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034bf7f-53c0-4f2a-9f52-d86ca96e6958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.319106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034bf7f-53c0-4f2a-9f52-d86ca96e6958 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.330411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 795/1610] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:25.331957 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.332099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.332304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.347362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 816/1611] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:25 2022] PUT /identity/v3/projects/0d5c124d1676439281367463aa3f2850/users/4cc14630ede646698bb19f803e9952ad/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:25.350385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09747ed-f3f1-4cc5-80ee-dfb6384449fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.355533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09747ed-f3f1-4cc5-80ee-dfb6384449fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.355857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09747ed-f3f1-4cc5-80ee-dfb6384449fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.359977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:25.362225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.399359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b09747ed-f3f1-4cc5-80ee-dfb6384449fd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:25.401360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b09747ed-f3f1-4cc5-80ee-dfb6384449fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.419383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:25.435128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 796/1612] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:25.435981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.498721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f40495-c3f3-4ba8-af2c-ac4f265a0707 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.502566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.503194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.503454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.503725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.525785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.527574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.537710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 817/1613] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:25.542786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.543099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.544952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.551373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 797/1614] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:25.552619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.568169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65f528-f761-45eb-8060-58400fc96027 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.573774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61419725-74d2-4eb8-b764-49bc6faa19a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.574576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61419725-74d2-4eb8-b764-49bc6faa19a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.575022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61419725-74d2-4eb8-b764-49bc6faa19a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.575921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61419725-74d2-4eb8-b764-49bc6faa19a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.576716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61419725-74d2-4eb8-b764-49bc6faa19a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.579216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61419725-74d2-4eb8-b764-49bc6faa19a7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.611538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] MFA Rules not processed for user `d137c134f30a4dfb8a47afd5579babcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:25.613683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.630812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 798/1615] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:25.637363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.638146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.638504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.661348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:25.662657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.669680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:25.723863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 818/1616] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:25.723863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.723863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.751377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 799/1617] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:25.751377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.769517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45710247-b5f4-47eb-ad20-6d78fe4938e5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.833344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcb303-d280-45fa-9bc6-7337e9ef8d78 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.840636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.841451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.841947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.842468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.845643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891760cd-b705-4b5d-a42e-1911fb60209f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.846522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891760cd-b705-4b5d-a42e-1911fb60209f service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.847982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891760cd-b705-4b5d-a42e-1911fb60209f service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.848420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891760cd-b705-4b5d-a42e-1911fb60209f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.853845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.855490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.860817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891760cd-b705-4b5d-a42e-1911fb60209f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.862623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891760cd-b705-4b5d-a42e-1911fb60209f service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.874907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 800/1618] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:25.876485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.893867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 819/1619] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:25.896592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c9f34-f78f-49d2-a91d-308fe00ae610 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.897226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c3344-ef4d-4d5d-94be-84553f29b3bb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.898879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c3344-ef4d-4d5d-94be-84553f29b3bb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.899173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c3344-ef4d-4d5d-94be-84553f29b3bb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.902477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d41c-cf1f-4a4a-bef7-d20a73bbd26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.903380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d41c-cf1f-4a4a-bef7-d20a73bbd26e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.903637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 820/1620] 10.222.0.88 () {54 vars in 912 bytes} [Mon Aug 29 23:22:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:22:25.904213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d41c-cf1f-4a4a-bef7-d20a73bbd26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.904703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d41c-cf1f-4a4a-bef7-d20a73bbd26e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.905510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d41c-cf1f-4a4a-bef7-d20a73bbd26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.907756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d41c-cf1f-4a4a-bef7-d20a73bbd26e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.907904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c3344-ef4d-4d5d-94be-84553f29b3bb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:25.936991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c3344-ef4d-4d5d-94be-84553f29b3bb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:25.938798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:25.948091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:25.948922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.949234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.949517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.952763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 801/1621] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/users => generated 308 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:25.952763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6df34-05b5-42c3-8d77-93b3b1cd62b8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.952763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6df34-05b5-42c3-8d77-93b3b1cd62b8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.953298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6df34-05b5-42c3-8d77-93b3b1cd62b8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.955253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 802/1622] 10.222.0.88 () {54 vars in 962 bytes} [Mon Aug 29 23:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:22:25.956272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:25.956620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:25.957018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:25.970602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:25.972068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:25.986317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:25.987767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:25.997876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 821/1623] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:25.998622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.026170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd37b2d-3448-487a-bc19-2e3e612ef1c7 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:26.037099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e37800-21b6-4d77-8d50-3db3f6de7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:26.037749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37800-21b6-4d77-8d50-3db3f6de7b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.038035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37800-21b6-4d77-8d50-3db3f6de7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.038309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37800-21b6-4d77-8d50-3db3f6de7b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.038958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e37800-21b6-4d77-8d50-3db3f6de7b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:26.040796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e37800-21b6-4d77-8d50-3db3f6de7b46 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:26.065745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 822/1624] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:26.067296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.069646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.070246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.080471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 803/1625] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:26.081345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.107523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef7a9f-507f-4e8b-a5d5-46433fb0b308 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:26.112577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:26.113397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:26.114282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.114620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.114885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:26.115039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] PATH_INFO: `/v3/projects/c8d64dcd9030462f8a406232fe31a281/users/6024cf5b83614309ab15c4fd8b466f95/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.136743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d64dcd9030462f8a406232fe31a281, user_id=6024cf5b83614309ab15c4fd8b466f95, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:26.139707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:26.142974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 823/1626] 10.222.0.88 () {58 vars in 1059 bytes} [Mon Aug 29 23:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:26.144375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.157134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 804/1627] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:26 2022] PUT /identity/v3/projects/c8d64dcd9030462f8a406232fe31a281/users/6024cf5b83614309ab15c4fd8b466f95/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:26.160460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.248653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e577d-3f33-469f-92ca-0cdde0a0fc36 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:26.260593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048ac3-a131-468f-b337-11bf4dd64e3f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:26.274628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:26.275512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.275907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.276734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.335066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:26.336191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.336489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.336770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.340544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:26.342414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:26.351002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:26.352615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:26.354045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 805/1628] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:26.355001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.365367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:26.400519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 824/1629] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:26.505053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b11bfe-3874-481f-9b82-3af295e7dc3a service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:26.531967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f45731-5811-4888-a960-5a7e1d450dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:26.532775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f45731-5811-4888-a960-5a7e1d450dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.533448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f45731-5811-4888-a960-5a7e1d450dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.534327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f45731-5811-4888-a960-5a7e1d450dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.536595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f45731-5811-4888-a960-5a7e1d450dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:26.542613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f45731-5811-4888-a960-5a7e1d450dd9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:26.577521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.586996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:26.589120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 806/1630] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:26.595343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dd408-8676-4d0c-bf07-69054f716e86 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:26.602386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41228-5492-4ea5-8c1d-29ce10bcc3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:26.603215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41228-5492-4ea5-8c1d-29ce10bcc3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.603508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41228-5492-4ea5-8c1d-29ce10bcc3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.603925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41228-5492-4ea5-8c1d-29ce10bcc3c7 admin admin] PATH_INFO: `/v3/projects/c8d64dcd9030462f8a406232fe31a281/users/6024cf5b83614309ab15c4fd8b466f95/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.606069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41228-5492-4ea5-8c1d-29ce10bcc3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d64dcd9030462f8a406232fe31a281, user_id=6024cf5b83614309ab15c4fd8b466f95, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:26.612296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41228-5492-4ea5-8c1d-29ce10bcc3c7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:26.646340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.646712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.646946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.675063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 825/1631] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:26 2022] PUT /identity/v3/projects/c8d64dcd9030462f8a406232fe31a281/users/6024cf5b83614309ab15c4fd8b466f95/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:26.725213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] MFA Rules not processed for user `6024cf5b83614309ab15c4fd8b466f95`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:26.726992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:26.781370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb84c1-d901-4f0b-85a1-1756e7b66891 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.782719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb84c1-d901-4f0b-85a1-1756e7b66891 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.782719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb84c1-d901-4f0b-85a1-1756e7b66891 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.784773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 826/1632] 10.222.0.88 () {54 vars in 912 bytes} [Mon Aug 29 23:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:22:26.793741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:26.794069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:26.794314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:26.851562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:26.854038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:26.900213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 807/1633] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:26.912833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:26.977008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 827/1634] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:27.028520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9c0eb-c643-4c27-9a8f-409efc95bd8c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:27.035655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:27.037292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:27.038600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:27.039093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:27.052304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:27.054597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:27.070059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 808/1635] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:26 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:27.194222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:27.205376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9a20-6b72-4276-928b-d20fe3c3874d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:27.211136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a2db8-a623-42e9-9017-0c7d5a154b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:27.212058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2db8-a623-42e9-9017-0c7d5a154b2e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:27.212212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2db8-a623-42e9-9017-0c7d5a154b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:27.212534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a2db8-a623-42e9-9017-0c7d5a154b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:27.245210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a2db8-a623-42e9-9017-0c7d5a154b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:27.247032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a2db8-a623-42e9-9017-0c7d5a154b2e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:27.263091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 828/1636] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:27.710710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:27.763039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:27.809546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78377d3-2188-4c42-b561-08fa2fa51609 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:27.817600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:27.818511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:27.818917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:27.819314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] PATH_INFO: `/v3/users/5b0fa1f043f549388dd32f85122f2a56` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:27.820621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0fa1f043f549388dd32f85122f2a56)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:27.823815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:27.888649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0fa1f043f549388dd32f85122f2a56'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:27.889810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0fa1f043f549388dd32f85122f2a56'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:27.918532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0fa1f043f549388dd32f85122f2a56'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:27.935117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0fa1f043f549388dd32f85122f2a56'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:27.936284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0fa1f043f549388dd32f85122f2a56'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:27.951530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 809/1637] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:27 2022] DELETE /identity/v3/users/5b0fa1f043f549388dd32f85122f2a56 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:27.956112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:27.956629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:27.956714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:27.998901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:28.001834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:28.148881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 829/1638] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:28.185428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:28.187326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:28.372481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16640613-341c-4a5b-83a4-492ee8253a88 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:28.380739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:28.381650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:28.383305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:28.383621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:28.406452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:28.407959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:28.428187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 810/1639] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:29.816415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:29.817859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:29.840787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683a245-412e-4382-8dd6-15c2acbcc32f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:29.851452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:29.852135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:29.852414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:29.852690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] PATH_INFO: `/v3/projects/dc4615a7eb114145b7da60a0da6635a5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:29.854922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4615a7eb114145b7da60a0da6635a5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:29.856870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:29.980414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4615a7eb114145b7da60a0da6635a5', 'request_id': 'req-48bef3e4-c845-4941-9043-3a2741818aab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:29.994831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4615a7eb114145b7da60a0da6635a5', 'request_id': 'req-48bef3e4-c845-4941-9043-3a2741818aab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.018723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4615a7eb114145b7da60a0da6635a5', 'request_id': 'req-48bef3e4-c845-4941-9043-3a2741818aab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.026755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:30.080060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] The token cache is being invalidate because project dc4615a7eb114145b7da60a0da6635a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:30.080357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.083107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.085611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 830/1640] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:29 2022] DELETE /identity/v3/projects/dc4615a7eb114145b7da60a0da6635a5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:30.090607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:30.116772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b18f42-14a9-4c9d-9661-199e6e8433e2 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:30.191673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:30.193791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:30.237944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:30.261542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:30.262202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:30.262485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:30.262761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] PATH_INFO: `/v3/users/6024cf5b83614309ab15c4fd8b466f95` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:30.265039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6024cf5b83614309ab15c4fd8b466f95)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:30.267281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:30.383651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6024cf5b83614309ab15c4fd8b466f95'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.385272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6024cf5b83614309ab15c4fd8b466f95'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.403770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6024cf5b83614309ab15c4fd8b466f95'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.429863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6024cf5b83614309ab15c4fd8b466f95'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.431422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4dcbd91e-4aa8-4ac9-9dc9-af9dd3039217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6024cf5b83614309ab15c4fd8b466f95'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.461214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 811/1641] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:30 2022] DELETE /identity/v3/users/6024cf5b83614309ab15c4fd8b466f95 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:30.502425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bef3e4-c845-4941-9043-3a2741818aab admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:30.612918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:30.613877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:30.614312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:30.614860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] PATH_INFO: `/v3/users/35810d5e373e4ee3ad0f991bb8357eda` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:30.619233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35810d5e373e4ee3ad0f991bb8357eda)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:30.620553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:22:30.620553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: warnings.warn(msg) Aug 29 23:22:30.620553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: Aug 29 23:22:30.624772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:30.785900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35810d5e373e4ee3ad0f991bb8357eda'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.788159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35810d5e373e4ee3ad0f991bb8357eda'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.819300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35810d5e373e4ee3ad0f991bb8357eda'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.835303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35810d5e373e4ee3ad0f991bb8357eda'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.836214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35810d5e373e4ee3ad0f991bb8357eda'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:30.890595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 831/1642] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:30 2022] DELETE /identity/v3/users/35810d5e373e4ee3ad0f991bb8357eda => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:30.895214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:30.895702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:30.896126 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:30.933893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:30.935368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:31.109885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 812/1643] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:31.131016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:31.137524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:31.213215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:31.286923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb1084-ba39-4f48-8f2a-67f51ccdec9e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:31.291629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55630ab-047d-4cbd-889f-3fd05fc6edd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:31.292408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55630ab-047d-4cbd-889f-3fd05fc6edd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:31.292694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55630ab-047d-4cbd-889f-3fd05fc6edd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:31.293137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55630ab-047d-4cbd-889f-3fd05fc6edd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:31.305143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55630ab-047d-4cbd-889f-3fd05fc6edd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:31.308069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55630ab-047d-4cbd-889f-3fd05fc6edd4 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:31.333977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 832/1644] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:31.815280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:31.816833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:31.834840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae5406-4d57-4f08-81fb-69520ac3ac1e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:31.849041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:31.849920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:31.850886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:31.852162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] PATH_INFO: `/v3/projects/c8d64dcd9030462f8a406232fe31a281` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:31.854476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d64dcd9030462f8a406232fe31a281)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:31.856165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:22:31.856165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: warnings.warn(msg) Aug 29 23:22:31.856165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: Aug 29 23:22:31.858229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:31.956076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d64dcd9030462f8a406232fe31a281', 'request_id': 'req-72ddc21d-6ca4-4009-b4e8-b79019be92ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:31.969762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d64dcd9030462f8a406232fe31a281', 'request_id': 'req-72ddc21d-6ca4-4009-b4e8-b79019be92ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.006594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d64dcd9030462f8a406232fe31a281', 'request_id': 'req-72ddc21d-6ca4-4009-b4e8-b79019be92ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.020283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:32.107321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] The token cache is being invalidate because project c8d64dcd9030462f8a406232fe31a281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:32.110621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.115975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.128724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 813/1645] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:31 2022] DELETE /identity/v3/projects/c8d64dcd9030462f8a406232fe31a281 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:32.130799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc228-3fa3-45ee-bc82-891274751aba None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.131285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc228-3fa3-45ee-bc82-891274751aba None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.131408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cc228-3fa3-45ee-bc82-891274751aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:32.182237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-958cc228-3fa3-45ee-bc82-891274751aba None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:32.184908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-958cc228-3fa3-45ee-bc82-891274751aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:32.403847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 833/1646] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:32.404246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:32.405523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:32.405759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.406267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.406498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:32.438623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddc21d-6ca4-4009-b4e8-b79019be92ad admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:32.450542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:32.453013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:32.456477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:32.458334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.458793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.459217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] PATH_INFO: `/v3/projects/83734562e27946119f6f398fb504b83a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:32.463138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83734562e27946119f6f398fb504b83a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:32.469395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:32.475623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 834/1647] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:32.485902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:32.518787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f1444-9d25-43be-aac4-4b2a609fdce4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:32.539154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:32.544451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.546671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.548542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:32.550699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:32.553542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:32.555371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:32.584813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 835/1648] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:32.598704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:32.610816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83734562e27946119f6f398fb504b83a', 'request_id': 'req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.633277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83734562e27946119f6f398fb504b83a', 'request_id': 'req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.661670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83734562e27946119f6f398fb504b83a', 'request_id': 'req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.678282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] The token cache is being invalidate because project 83734562e27946119f6f398fb504b83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:32.678932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.679821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f1a08a09-e533-423c-ad34-6fc2cf1a86e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:32.682459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 814/1649] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:32 2022] DELETE /identity/v3/projects/83734562e27946119f6f398fb504b83a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:32.687520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc7f4-f1cd-46a7-94a5-cf941b7895a4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:32.690213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3e89-1133-4dc5-8708-fba1c4291597 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.690519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3e89-1133-4dc5-8708-fba1c4291597 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.690792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc3e89-1133-4dc5-8708-fba1c4291597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:32.772371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a1cc3e89-1133-4dc5-8708-fba1c4291597 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:32.786603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a1cc3e89-1133-4dc5-8708-fba1c4291597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:32.874998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:32.877882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.879766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.879899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:32.880535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:32.884212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:32.971712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 815/1650] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:32.973559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:32.974013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:32.974702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 836/1651] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:32 2022] POST /identity/v3/projects => generated 379 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:32.979761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:32.982071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:32.984419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.083134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:33.108761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:33.114780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:33.157366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1a35e-7760-4c3a-a827-b5dfca6d3c74 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.172139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.173010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.173462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.173890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.174701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.177017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.228307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 837/1652] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:32 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:33.232653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.245876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd4821-bc07-4ed2-9e14-5ecd16b4f69f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.260590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.261257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.261544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.261822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.264424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.264424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.322865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 838/1653] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:33.327207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.349854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 816/1654] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:33.351094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.353500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fee45-ed65-4d6e-bacf-ebf87079cc9e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.373780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.374376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.374766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.375150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.376456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0fe52-217b-4989-a4ae-06223274907c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.377691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.379809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.394897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 839/1655] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:22:33.399471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.400384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.400662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.400930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.404512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:33.404512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.404512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.407250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.420699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33bd7-1f89-4751-9bcd-bc28c1af88da admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.426451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98794f-ecae-44fb-833e-acb93a54b547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.427297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98794f-ecae-44fb-833e-acb93a54b547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.429065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98794f-ecae-44fb-833e-acb93a54b547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.429065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98794f-ecae-44fb-833e-acb93a54b547 admin admin] PATH_INFO: `/v3/projects/74b07f9abecc4adfaee5b5f024cb6c4e/users/cd7583d595fa463cb1fdb2e0b8dd6e14/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.471100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 817/1656] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:33.475299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.484471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98794f-ecae-44fb-833e-acb93a54b547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b07f9abecc4adfaee5b5f024cb6c4e, user_id=cd7583d595fa463cb1fdb2e0b8dd6e14, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.497186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:33.499986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98794f-ecae-44fb-833e-acb93a54b547 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.503663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea3ef-967a-42a3-9df1-7876c9dcc78d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.512079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.512919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.513201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.513467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.514249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.518291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.559468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 840/1657] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:33 2022] PUT /identity/v3/projects/74b07f9abecc4adfaee5b5f024cb6c4e/users/cd7583d595fa463cb1fdb2e0b8dd6e14/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:33.568342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.568633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.568913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.615536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 818/1658] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:33 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:22:33.620049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.669661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] MFA Rules not processed for user `cd7583d595fa463cb1fdb2e0b8dd6e14`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:33.681442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:33.879204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309dca-1649-425f-b998-dbc448929b22 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:33.894697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:33.895369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:33.898556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:33.898841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:33.899571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:33.906396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:33.945057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 841/1659] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:33.951127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:33.957214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:33.987455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 819/1660] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:33 2022] POST /identity/v3/users => generated 286 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:33.988091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.022195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69c3d2-1ba3-4c18-9abc-ca1ab6eef72b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.031429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e30b4-6b11-473c-a1e3-66d4c3a26147 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.048931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.049627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.049914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.050190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] PATH_INFO: `/v3/users/d137c134f30a4dfb8a47afd5579babcc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.059743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d137c134f30a4dfb8a47afd5579babcc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.061787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.066134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.066663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.066958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.067263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.067944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.069989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.177531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 820/1661] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:33 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:34.179073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.224110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd137c134f30a4dfb8a47afd5579babcc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:34.224921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd137c134f30a4dfb8a47afd5579babcc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:34.260153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd137c134f30a4dfb8a47afd5579babcc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:34.265378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:34.294686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd137c134f30a4dfb8a47afd5579babcc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:34.297554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd137c134f30a4dfb8a47afd5579babcc'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:34.366772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 842/1662] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:33 2022] DELETE /identity/v3/users/d137c134f30a4dfb8a47afd5579babcc => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:34.369479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.377028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:34.421548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9984b-96b6-47fb-8546-0b4a7143ad15 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.573728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:34.588701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01757f7f-8194-4212-b91a-d3e73c615121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.589672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757f7f-8194-4212-b91a-d3e73c615121 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.590225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757f7f-8194-4212-b91a-d3e73c615121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.590439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01757f7f-8194-4212-b91a-d3e73c615121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.591339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01757f7f-8194-4212-b91a-d3e73c615121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.593005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01757f7f-8194-4212-b91a-d3e73c615121 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.623746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 821/1663] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:34.625086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.625396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.625676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.655921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23e02-b02a-4511-8aea-ce2f2716a437 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.674752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:34.678724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.679375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.679667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.679932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.680578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.683102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.695683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:34.715348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 822/1664] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:34.717977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.745719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 843/1665] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:34 2022] POST /identity/v3/users => generated 295 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:34.750991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.754299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:34.780694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed4921-c1f7-42c8-8068-f9447b9e4ad4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.783165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa99d9a-2c55-4129-b64f-a3a34c7d470f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.796408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.798900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.799600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.799957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.800431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.801269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.802990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.804615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.804904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.805365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.807977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.811412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.829189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 823/1666] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:34.833463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.855135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 844/1667] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:34.855865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.867838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5689ea-f937-428b-93b6-7cd52df00382 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.878052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b0bb-520a-405e-86f2-3eeb22ec3318 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:34.885498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.886229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.886518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.886802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] PATH_INFO: `/v3/projects/c0cb517b21eb410b9fed871c3ed12dd6/users/6a6a185fb2dc4a55a3211a1ca7112aaf/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.897314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:34.898998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:34.898998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:34.898998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] PATH_INFO: `/v3/projects/593bdd5a761d485892cf80b3d5cd1bbd/users/a4da84dee4294321bc1c5a1295422180/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:34.944134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] RBAC: Authorizing `identity:create_grant(project_id=593bdd5a761d485892cf80b3d5cd1bbd, user_id=a4da84dee4294321bc1c5a1295422180, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.947733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cb517b21eb410b9fed871c3ed12dd6, user_id=6a6a185fb2dc4a55a3211a1ca7112aaf, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:34.950585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.956742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:34.984117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 845/1668] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:34 2022] PUT /identity/v3/projects/593bdd5a761d485892cf80b3d5cd1bbd/users/a4da84dee4294321bc1c5a1295422180/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:22:34.985149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:34.991627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:35.018511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 824/1669] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:34 2022] PUT /identity/v3/projects/c0cb517b21eb410b9fed871c3ed12dd6/users/6a6a185fb2dc4a55a3211a1ca7112aaf/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:35.018511 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:35.142382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55dfaa-8ba5-4b16-9d5a-63300e57848e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:35.245946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d245a5-290a-4aa0-8959-289a69b56bf1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:35.252626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ed5d-1380-4547-a208-70ea1a37c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:35.253318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ed5d-1380-4547-a208-70ea1a37c326 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.253604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ed5d-1380-4547-a208-70ea1a37c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.253883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ed5d-1380-4547-a208-70ea1a37c326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.254897 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ed5d-1380-4547-a208-70ea1a37c326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:35.257219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ed5d-1380-4547-a208-70ea1a37c326 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:35.261702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:35.281258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:35.281897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.282181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.282458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.292662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 825/1670] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:35.299536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.299829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.300130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.301926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:35.310162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:35.332791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 846/1671] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:35.333667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:35.345737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] MFA Rules not processed for user `6a6a185fb2dc4a55a3211a1ca7112aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:35.347083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:35.358966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6559c-f6d3-4f7a-9702-db7689a30f63 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:35.386320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe798306-bf60-4d82-ac3b-db7ac823ee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:35.387215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe798306-bf60-4d82-ac3b-db7ac823ee70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.387682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe798306-bf60-4d82-ac3b-db7ac823ee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.388154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe798306-bf60-4d82-ac3b-db7ac823ee70 admin admin] PATH_INFO: `/v3/projects/593bdd5a761d485892cf80b3d5cd1bbd/users/a4da84dee4294321bc1c5a1295422180/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.390378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe798306-bf60-4d82-ac3b-db7ac823ee70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593bdd5a761d485892cf80b3d5cd1bbd, user_id=a4da84dee4294321bc1c5a1295422180, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:35.393383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe798306-bf60-4d82-ac3b-db7ac823ee70 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:35.423806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 847/1672] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:35 2022] PUT /identity/v3/projects/593bdd5a761d485892cf80b3d5cd1bbd/users/a4da84dee4294321bc1c5a1295422180/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:35.434812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.436270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.437914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.476567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] MFA Rules not processed for user `a4da84dee4294321bc1c5a1295422180`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:35.479038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:35.491172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 826/1673] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:35.492528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:35.511376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5d9a-4c77-4047-8ea8-5c3d2ce443ae None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:35.575177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:35.615098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:35.615773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.615994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.616266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.616899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:35.618677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 848/1674] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:35.624989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:35.631635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:35.633491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:35.688862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 827/1675] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:35 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:35.693235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:35.723265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6616b-6a29-41fd-b387-e24381b61635 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:35.797216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:35.798984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.801530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.801996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.807403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:35.865698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141de24-c92f-406c-aa60-58bdc1765e02 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:35.875586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:35.877817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:35.878571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:35.878978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:35.879349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:35.880630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:35.888105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:35.996032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 828/1676] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:35 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:36.000189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:36.017053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:36.019054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:36.021238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf231d91-a7eb-4dd6-be31-3279835706f5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:36.034599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:36.035373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:36.035754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:36.036137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:36.038381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:36.041561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:36.056448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 849/1677] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:22:36.089351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:36.090304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 829/1678] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:36.105336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1745599-430b-4c3e-ae36-d8e67bfa1e94 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:36.117679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32553-912f-4836-8765-705201dde850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:36.119452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32553-912f-4836-8765-705201dde850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:36.119946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32553-912f-4836-8765-705201dde850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:36.120421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32553-912f-4836-8765-705201dde850 admin admin] PATH_INFO: `/v3/projects/ad0a049962004a4b919596934e4248ae/users/d8726fc6640748b19b5d717b7fe56dc2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:36.170615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32553-912f-4836-8765-705201dde850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0a049962004a4b919596934e4248ae, user_id=d8726fc6640748b19b5d717b7fe56dc2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:36.177745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32553-912f-4836-8765-705201dde850 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:36.212747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 850/1679] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:36 2022] PUT /identity/v3/projects/ad0a049962004a4b919596934e4248ae/users/d8726fc6640748b19b5d717b7fe56dc2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:36.216729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:36.232014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca98b6c-1d31-4fe2-9095-31b96d31bfbd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:36.420604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89b2f3-ddd2-421c-8ef7-13c27f911f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:36.426849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b2f3-ddd2-421c-8ef7-13c27f911f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:36.427347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b2f3-ddd2-421c-8ef7-13c27f911f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:36.427736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89b2f3-ddd2-421c-8ef7-13c27f911f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:36.428611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b2f3-ddd2-421c-8ef7-13c27f911f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:36.441035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89b2f3-ddd2-421c-8ef7-13c27f911f2a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:36.479708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 830/1680] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:36.480806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32553-912f-4836-8765-705201dde850 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:36.509910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32553-912f-4836-8765-705201dde850 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:36.528105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:36.528962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:36.529874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:36.530261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] PATH_INFO: `/v3/projects/ad0a049962004a4b919596934e4248ae/users/d8726fc6640748b19b5d717b7fe56dc2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:36.535352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0a049962004a4b919596934e4248ae, user_id=d8726fc6640748b19b5d717b7fe56dc2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:36.540175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:36.578873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 851/1681] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:36 2022] PUT /identity/v3/projects/ad0a049962004a4b919596934e4248ae/users/d8726fc6640748b19b5d717b7fe56dc2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:36.590867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:36.591353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:36.591756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:36.660496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] MFA Rules not processed for user `d8726fc6640748b19b5d717b7fe56dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:36.662068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:36.725651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:36.850803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 831/1682] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:36.863791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:36.984754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7110aa4-d3c9-42f7-a18d-1d7a4f31ad12 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:36.992043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:36.994524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:36.994524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:36.994524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:37.007112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:37.009609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:37.024320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 852/1683] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:37.213024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:37.228127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dfb28-1c00-473f-b44e-0984d5b6fd9a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:37.233567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:37.234574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:37.234997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:37.235481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:37.331530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:37.332982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:37.355560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 832/1684] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:38.033559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:38.035938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:38.068331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7589db-c09d-4b60-8d18-2e41da072642 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:38.085376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03148b-de9a-4d67-9567-6bd9211ba62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:38.086281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03148b-de9a-4d67-9567-6bd9211ba62d service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:38.086779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03148b-de9a-4d67-9567-6bd9211ba62d service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:38.087421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03148b-de9a-4d67-9567-6bd9211ba62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:38.163127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:38.164712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:38.297535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03148b-de9a-4d67-9567-6bd9211ba62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:38.303974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03148b-de9a-4d67-9567-6bd9211ba62d service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:38.332413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4e42d-7191-4e0c-8308-aa36da43ba64 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:38.332645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 853/1685] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:38.341720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:38.342390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:38.342673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:38.342952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] PATH_INFO: `/v3/projects/c8f60d918f794e3bb336f376f5ca6a62` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:38.345922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f60d918f794e3bb336f376f5ca6a62)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:38.348999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:38.489159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f60d918f794e3bb336f376f5ca6a62', 'request_id': 'req-d4112589-d6b5-454c-9656-5d0d18e415ed'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:38.508246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f60d918f794e3bb336f376f5ca6a62', 'request_id': 'req-d4112589-d6b5-454c-9656-5d0d18e415ed'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:38.526921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f60d918f794e3bb336f376f5ca6a62', 'request_id': 'req-d4112589-d6b5-454c-9656-5d0d18e415ed'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:38.532489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:38.555034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] The token cache is being invalidate because project c8f60d918f794e3bb336f376f5ca6a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:38.555542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:38.557546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d4112589-d6b5-454c-9656-5d0d18e415ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:38.562508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 833/1686] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:38 2022] DELETE /identity/v3/projects/c8f60d918f794e3bb336f376f5ca6a62 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:38.567539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396574c-d633-441e-8785-6447fb79a28a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:38.569397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396574c-d633-441e-8785-6447fb79a28a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:38.569835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396574c-d633-441e-8785-6447fb79a28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:38.599851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:38.600141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:38.600449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:38.639799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d396574c-d633-441e-8785-6447fb79a28a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:38.646360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] MFA Rules not processed for user `45416134d3204770a6ddc7f61538fc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:38.647131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d396574c-d633-441e-8785-6447fb79a28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:38.647567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:38.699152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:38.819876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 854/1687] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:38.834504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:38.834813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:38.835095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:38.872104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:38.879407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:38.901563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 834/1688] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:38.914320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 855/1689] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:38.915316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:38.918388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:38.920340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:38.938362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf778f-98a4-4f14-9fcb-5c70c1b6ae0a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:38.963321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:38.964110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:38.964487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:38.964687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:38.965347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:38.965653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:38.967341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.012669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 835/1690] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:22:39.018073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:39.041863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa49548-b311-401c-85e0-4d9bc5519ada admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:39.054036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:39.054709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.055535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.055535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.056254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:39.062021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.095363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba39069-11ad-4508-9e07-f8b3ac4675b1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:39.106489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:39.107309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.110287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.110805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.127164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:39.129597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.129725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 836/1691] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:39 2022] POST /identity/v3/projects => generated 357 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:22:39.135121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:39.146912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 856/1692] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:22:39.343678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c6465-100d-4773-afb6-1dbfbba672cb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:39.354879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:39.356132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.357844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.358883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.360930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:39.367189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.432326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 837/1693] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:39 2022] POST /identity/v3/users => generated 279 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:22:39.432785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:39.453684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421abd-bb0f-4b64-be18-b98701788ae8 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:39.468825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:39.471699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.474179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.474653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.475604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:39.480293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.507779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 857/1694] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:22:39.510053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:39.531416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023f02b-926d-4839-82d0-a50e48b11ffc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:39.537035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e4fbf-546a-4824-a50f-e9336e786363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:39.537696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e4fbf-546a-4824-a50f-e9336e786363 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.537980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e4fbf-546a-4824-a50f-e9336e786363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.538258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e4fbf-546a-4824-a50f-e9336e786363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.538919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e4fbf-546a-4824-a50f-e9336e786363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:39.540890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e4fbf-546a-4824-a50f-e9336e786363 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.596217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 838/1695] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:39.597357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:39.617519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772d537-c154-4014-bad5-b67b0d085133 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:39.636774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:39.638073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.639944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.642450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] PATH_INFO: `/v3/projects/3a51ab6b7d3442ba9effaa98f0327e76/users/0e8ce52d919e4d2d8abac2139a7e78c8/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.693679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a51ab6b7d3442ba9effaa98f0327e76, user_id=0e8ce52d919e4d2d8abac2139a7e78c8, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:39.698891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:39.746917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 858/1696] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:39 2022] PUT /identity/v3/projects/3a51ab6b7d3442ba9effaa98f0327e76/users/0e8ce52d919e4d2d8abac2139a7e78c8/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:39.751336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:39.751701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:39.752112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:39.826039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] MFA Rules not processed for user `0e8ce52d919e4d2d8abac2139a7e78c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:39.827620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:39.855886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:39.973892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 839/1697] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:39.976262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:40.231740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1d654-ed80-4b2c-b7e5-113967ee2a06 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:40.248240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:40.248947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:40.249263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:40.249545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:40.251757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:40.258777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:40.335111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:40.356107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 859/1698] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:39 2022] POST /identity/v3/projects => generated 357 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:40.361609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:40.385751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd5ae-dc1a-4d31-9ea7-cc6d8b32ed0c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:40.596099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:40.597148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:40.597434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:40.597707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:40.598365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:40.600360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:40.646230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 840/1699] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:40 2022] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:40.652272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:40.675261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4bce4-731c-4be7-ae84-6e6e35d50f9f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:40.699074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:40.699732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:40.700020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:40.700299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:40.700958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:40.717861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:40.809939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 860/1700] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:22:40.810181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:40.826677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c182dc-15fd-4102-b66d-8d4b1cade52d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:40.842252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:40.844344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:40.844638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:40.844921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] PATH_INFO: `/v3/projects/663432540bfc4d55bf896f2d7f1b4720/users/d9204756537e4bc18249afe880f75055/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:40.938055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=663432540bfc4d55bf896f2d7f1b4720, user_id=d9204756537e4bc18249afe880f75055, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:40.944108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:41.029367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 841/1701] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:40 2022] PUT /identity/v3/projects/663432540bfc4d55bf896f2d7f1b4720/users/d9204756537e4bc18249afe880f75055/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:22:41.029586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:41.072003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c14a2-ed81-4b3c-825c-b079de9186e1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:41.237284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06f30c-a4b4-4efa-b11f-5bd7ab4de9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:41.239050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f30c-a4b4-4efa-b11f-5bd7ab4de9af admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:41.239407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f30c-a4b4-4efa-b11f-5bd7ab4de9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:41.239755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06f30c-a4b4-4efa-b11f-5bd7ab4de9af admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:41.245942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f30c-a4b4-4efa-b11f-5bd7ab4de9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:41.247684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06f30c-a4b4-4efa-b11f-5bd7ab4de9af admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:41.292939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 861/1702] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:41.298195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:41.325800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c61973-032e-4605-a829-925a1bd3bb3a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:41.345193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:41.346975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:41.347715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:41.348508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] PATH_INFO: `/v3/projects/663432540bfc4d55bf896f2d7f1b4720/users/d9204756537e4bc18249afe880f75055/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:41.356655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=663432540bfc4d55bf896f2d7f1b4720, user_id=d9204756537e4bc18249afe880f75055, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:41.376904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:41.413365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 842/1703] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:41 2022] PUT /identity/v3/projects/663432540bfc4d55bf896f2d7f1b4720/users/d9204756537e4bc18249afe880f75055/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:41.428336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb441f-3dfc-4e29-be60-7a58e9b49808 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:41.428676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb441f-3dfc-4e29-be60-7a58e9b49808 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:41.428911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb441f-3dfc-4e29-be60-7a58e9b49808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:41.482602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5acb441f-3dfc-4e29-be60-7a58e9b49808 None None] MFA Rules not processed for user `d9204756537e4bc18249afe880f75055`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:41.483860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5acb441f-3dfc-4e29-be60-7a58e9b49808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:41.762325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 862/1704] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:41.782250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:41.789044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:41.825511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:41.826121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:41.826603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:41.901249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] MFA Rules not processed for user `f78dfe819ddb47928a9c37ca768147aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:41.902765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:41.980396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912b85b-47e1-4d1e-9e1f-30f3bfa4d37c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:41.990927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e4183-4ee4-45ca-9952-e5b5c77da702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:41.991560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4183-4ee4-45ca-9952-e5b5c77da702 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:41.991835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4183-4ee4-45ca-9952-e5b5c77da702 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:41.992105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e4183-4ee4-45ca-9952-e5b5c77da702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:42.033590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e4183-4ee4-45ca-9952-e5b5c77da702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:42.035665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6e4183-4ee4-45ca-9952-e5b5c77da702 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:42.060635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 843/1705] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:42.085986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:42.109445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 863/1706] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:42.112555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:42.113229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:42.113709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:42.173298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] MFA Rules not processed for user `f78dfe819ddb47928a9c37ca768147aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:42.177487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:42.204917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 844/1707] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:42.217863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:42.219939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:42.221990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:42.242390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:42.259618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f801c-1aab-4d18-b9ed-19a22504f4d7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:42.275275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:42.279157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:42.280788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:42.282134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:42.494402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:42.499841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:42.537872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 845/1708] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:42.558665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9034ffb-d51d-4652-888e-19e2482de0c9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:42.573441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3b7b2-f07a-479c-8d56-f739c0bf04c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:42.574061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b7b2-f07a-479c-8d56-f739c0bf04c2 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:42.574343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b7b2-f07a-479c-8d56-f739c0bf04c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:42.583721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3b7b2-f07a-479c-8d56-f739c0bf04c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:42.652348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3b7b2-f07a-479c-8d56-f739c0bf04c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:42.661513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3b7b2-f07a-479c-8d56-f739c0bf04c2 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:42.702510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 864/1709] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:44.207287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:44.209648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:44.227904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434dec-659f-4676-afa2-fa1007427b03 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:44.228449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434dec-659f-4676-afa2-fa1007427b03 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:44.228545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29434dec-659f-4676-afa2-fa1007427b03 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:44.229923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 865/1710] 10.222.0.88 () {54 vars in 912 bytes} [Mon Aug 29 23:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:22:44.235771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:44.236048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:44.236482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:44.366054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:44.367301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:44.492652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e1bd8-9b92-47a3-89f9-dd17ab6cc598 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:44.537310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:44.542594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:44.542880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:44.543157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] PATH_INFO: `/v3/users/cd7583d595fa463cb1fdb2e0b8dd6e14` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:44.553658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7583d595fa463cb1fdb2e0b8dd6e14)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:44.563251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:44.579319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 866/1711] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:22:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 23:22:44.709464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:44.710928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:44.736266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4e1c-cc11-4b5b-9f3b-c6585ae846cf None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:44.753608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7583d595fa463cb1fdb2e0b8dd6e14'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:44.754775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7583d595fa463cb1fdb2e0b8dd6e14'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:44.771446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff2f36-f126-4434-a9f4-9b9c01644a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:44.773321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7583d595fa463cb1fdb2e0b8dd6e14'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:44.773819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2f36-f126-4434-a9f4-9b9c01644a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:44.775074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2f36-f126-4434-a9f4-9b9c01644a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:44.780254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff2f36-f126-4434-a9f4-9b9c01644a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:44.813889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7583d595fa463cb1fdb2e0b8dd6e14'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:44.816218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cbf79044-2c1b-49b7-9a65-165ea624a21b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7583d595fa463cb1fdb2e0b8dd6e14'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:44.818090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2f36-f126-4434-a9f4-9b9c01644a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:44.822060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff2f36-f126-4434-a9f4-9b9c01644a9c service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:44.844740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 867/1712] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:44.868547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 846/1713] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:44 2022] DELETE /identity/v3/users/cd7583d595fa463cb1fdb2e0b8dd6e14 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:44.870689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:44.882012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:44.882485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:44.883267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:44.883745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:44.884369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:44.944912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:44.946668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:45.019395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] MFA Rules not processed for user `4cc14630ede646698bb19f803e9952ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:45.020636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:45.048662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:45.230354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 868/1714] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:45.258614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:45.260401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:45.280153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:45.382041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 847/1715] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:45.394430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:45.399009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:45.538081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19646f-8cca-4622-86a2-f054c0cfba98 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:45.562670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc319b-162e-4ad2-bbab-3176738ffaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:45.563353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc319b-162e-4ad2-bbab-3176738ffaed service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:45.563641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc319b-162e-4ad2-bbab-3176738ffaed service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:45.563919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc319b-162e-4ad2-bbab-3176738ffaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:45.607099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc319b-162e-4ad2-bbab-3176738ffaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:45.611575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc319b-162e-4ad2-bbab-3176738ffaed service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:45.665269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 869/1716] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:22:45.670267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:45.672015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:45.672908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:45.714083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fd7a9-cff1-4c37-9078-649173bfc5a9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:45.731755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293beb4-cfd0-485d-b60f-1ae8a69f2f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:45.732711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293beb4-cfd0-485d-b60f-1ae8a69f2f85 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:45.732875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293beb4-cfd0-485d-b60f-1ae8a69f2f85 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:45.733914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293beb4-cfd0-485d-b60f-1ae8a69f2f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:45.734327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] MFA Rules not processed for user `45416134d3204770a6ddc7f61538fc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:45.739477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:45.763405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293beb4-cfd0-485d-b60f-1ae8a69f2f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:45.767473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293beb4-cfd0-485d-b60f-1ae8a69f2f85 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:45.824284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 848/1717] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:45.937146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 870/1718] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:46.710059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5571ba-7497-4afa-ab5e-8792d5fdc9f4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:46.710526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5571ba-7497-4afa-ab5e-8792d5fdc9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:46.710609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5571ba-7497-4afa-ab5e-8792d5fdc9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:46.720343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:46.722350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:46.746161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6c5f4-afde-46e3-84d1-986b4abadd90 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:46.763529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:46.764194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:46.764471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:46.764935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] PATH_INFO: `/v3/projects/74b07f9abecc4adfaee5b5f024cb6c4e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:46.766365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b07f9abecc4adfaee5b5f024cb6c4e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:46.769082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:46.806969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0c5571ba-7497-4afa-ab5e-8792d5fdc9f4 None None] MFA Rules not processed for user `642764a1a825436bb4912e33f2cb4135`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:46.810436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c5571ba-7497-4afa-ab5e-8792d5fdc9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:46.931778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b07f9abecc4adfaee5b5f024cb6c4e', 'request_id': 'req-59975106-0eab-49bc-9d5c-afa333f9f1c5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:46.963806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b07f9abecc4adfaee5b5f024cb6c4e', 'request_id': 'req-59975106-0eab-49bc-9d5c-afa333f9f1c5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.007319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b07f9abecc4adfaee5b5f024cb6c4e', 'request_id': 'req-59975106-0eab-49bc-9d5c-afa333f9f1c5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.010565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 849/1719] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:47.012417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:47.012918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:47.013468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:47.042967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] The token cache is being invalidate because project 74b07f9abecc4adfaee5b5f024cb6c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:47.043606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.045278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.049440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 871/1720] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:46 2022] DELETE /identity/v3/projects/74b07f9abecc4adfaee5b5f024cb6c4e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:47.053408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:47.081355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:47.093069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] MFA Rules not processed for user `642764a1a825436bb4912e33f2cb4135`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:47.100112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:47.168356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:47.237481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:47.308925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 850/1721] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:47.315570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59975106-0eab-49bc-9d5c-afa333f9f1c5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:47.322684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:47.323420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:47.323756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:47.324035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] PATH_INFO: `/v3/users/a4da84dee4294321bc1c5a1295422180` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:47.325301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4da84dee4294321bc1c5a1295422180)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:47.328187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:47.335499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:47.338064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:47.499882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4da84dee4294321bc1c5a1295422180'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.505850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4da84dee4294321bc1c5a1295422180'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.531758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4da84dee4294321bc1c5a1295422180'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.548207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4da84dee4294321bc1c5a1295422180'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.549269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4da84dee4294321bc1c5a1295422180'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:47.603478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 872/1722] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:47 2022] DELETE /identity/v3/users/a4da84dee4294321bc1c5a1295422180 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:47.603478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:47.608124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:47.683116 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8c3b5-ba52-4d72-ac28-a4f5e0bc6d19 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:47.907356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b58fa9-8be7-4be1-96ca-66ed0726585e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:47.926155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:47.929050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:47.931824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:47.932231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:47.935227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:47.936366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:47.937467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:47.938872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:47.939205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:47.946619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:47.971840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:47.973525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589bc66-926f-48b2-a3d5-d0ddd7895921 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:48.006530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 851/1723] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:48.007863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:48.008151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:48.008428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:48.111840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] MFA Rules not processed for user `55c184b749004ac298bb634bc948c537`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:48.113123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:48.187113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:48.204884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:48.218762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9088e-5462-4314-b38e-57d0835bb9b3 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:48.264532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 873/1724] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:48.265832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ceae-2c86-46b0-98ce-8c35bd4d20db None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:48.266122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ceae-2c86-46b0-98ce-8c35bd4d20db None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:48.266396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1ceae-2c86-46b0-98ce-8c35bd4d20db None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:48.280530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 874/1725] 10.222.0.88 () {54 vars in 912 bytes} [Mon Aug 29 23:22:48 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:22:48.286789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:48.287081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:48.287356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:48.307770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:48.360304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:48.364616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:48.373305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 852/1726] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:48.519121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 875/1727] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:22:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:48.815180 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:48.816724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:48.979477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:48.981304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:49.000989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f776191-23ec-4232-acf8-f0533dd001a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.004018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7eeeb-2734-4222-b68a-a86840a297d6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.024750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6423b-45bc-497b-901d-91a9ff759921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.025553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6423b-45bc-497b-901d-91a9ff759921 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.025842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6423b-45bc-497b-901d-91a9ff759921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.026613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6423b-45bc-497b-901d-91a9ff759921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.028808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.029383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.029660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.029933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] PATH_INFO: `/v3/projects/593bdd5a761d485892cf80b3d5cd1bbd` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.034961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=593bdd5a761d485892cf80b3d5cd1bbd)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.037286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.051604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6423b-45bc-497b-901d-91a9ff759921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.053090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6423b-45bc-497b-901d-91a9ff759921 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.089404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 876/1728] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:22:49.158203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593bdd5a761d485892cf80b3d5cd1bbd', 'request_id': 'req-8341200e-924a-4f07-aadd-7bd8d1d52ffd'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:49.175854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593bdd5a761d485892cf80b3d5cd1bbd', 'request_id': 'req-8341200e-924a-4f07-aadd-7bd8d1d52ffd'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:49.187212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593bdd5a761d485892cf80b3d5cd1bbd', 'request_id': 'req-8341200e-924a-4f07-aadd-7bd8d1d52ffd'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:49.214818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] The token cache is being invalidate because project 593bdd5a761d485892cf80b3d5cd1bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:49.215169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:49.215792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8341200e-924a-4f07-aadd-7bd8d1d52ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:49.220809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 853/1729] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:48 2022] DELETE /identity/v3/projects/593bdd5a761d485892cf80b3d5cd1bbd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:49.222425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.222743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.223089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.265653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:49.266950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:49.406442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 877/1730] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:49.411803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.412100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.412382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.454681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:49.468028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:49.478942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 854/1731] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:49.483012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:49.498914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6bdc-66c6-4d46-a910-f9480b20a0a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.504121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.505088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.505625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.506265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.507385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:22:49.507974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.510275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.543066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 878/1732] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:22:49.547361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:49.561157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2f1e7-6230-4e6a-a9a4-22337266c22e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.575413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.576066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.576349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.576712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.577308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.579485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.628735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 855/1733] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:49 2022] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:49.633026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:49.649158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f3cb-bd49-4c63-9dc1-9a835f97c28d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.775446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.776087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.776372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.776651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.777337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.779973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.847509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 879/1734] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:49 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:49.850150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:49.864538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d4c9d-3014-4381-8886-04cf2d820667 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.869530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.870159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.870492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.870766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.871430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.873249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.888985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 856/1735] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:49.891348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:49.905661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f1c0-f061-40f0-b3ca-ee3f3c451e07 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:49.923513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c82fc2-6b12-4bab-ab65-64864d55ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:49.925045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82fc2-6b12-4bab-ab65-64864d55ef04 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:49.930248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82fc2-6b12-4bab-ab65-64864d55ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:49.932001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c82fc2-6b12-4bab-ab65-64864d55ef04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:49.934474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c82fc2-6b12-4bab-ab65-64864d55ef04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:49.941560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c82fc2-6b12-4bab-ab65-64864d55ef04 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:49.943561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:49.967676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 880/1736] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:49.972579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:50.002553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751220ee-1637-4c1d-99d5-81a575de15ff admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:50.020898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:50.023216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:50.031199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:50.033682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] PATH_INFO: `/v3/projects/b3b9ba90fa524cca8df926631e149a61/users/3b1f22adafa94c14a974f4abac331418/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:50.141789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b9ba90fa524cca8df926631e149a61, user_id=3b1f22adafa94c14a974f4abac331418, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:50.159549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:50.208553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 857/1737] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:49 2022] PUT /identity/v3/projects/b3b9ba90fa524cca8df926631e149a61/users/3b1f22adafa94c14a974f4abac331418/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:50.219580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:50.220570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:50.221207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:50.296453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] MFA Rules not processed for user `3b1f22adafa94c14a974f4abac331418`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:50.297982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:50.488543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 881/1738] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:50.493918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:50.597660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:50.761160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cb2f7-9786-4f40-a7f9-e9ec098c52bb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:50.773354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:50.773999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:50.774820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:50.775100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:50.776550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:50.778907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:50.823373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 858/1739] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:22:50 2022] POST /identity/v3/projects => generated 389 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:50.827411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:50.845314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678f12f-b785-4326-83a9-9880dac0600e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:50.951117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:50.951999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:50.952425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:50.952903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:50.953739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:50.956491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:50.989050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 882/1740] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:22:50 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:22:50.993894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:51.031878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b248e-b10f-4e75-aa85-e700c8adf320 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:51.057828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:51.060259 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.060610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.062935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:51.095389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:51.097049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:51.154320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:51.157798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 859/1741] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:51.194848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d02f4-50c8-4d05-9d15-d630383be01c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:51.223179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:51.223869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.224197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.224473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] PATH_INFO: `/v3/projects/d50449de3b3e40fe8341abf4d10d1929/users/3d403ca9ac23460289e69931936fa9ad/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:51.262453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50449de3b3e40fe8341abf4d10d1929, user_id=3d403ca9ac23460289e69931936fa9ad, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:51.265484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:51.307897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 883/1742] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:51 2022] PUT /identity/v3/projects/d50449de3b3e40fe8341abf4d10d1929/users/3d403ca9ac23460289e69931936fa9ad/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:22:51.313356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:51.335194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab0691-ec4b-4785-9c32-bd8c7ce87bd9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:51.391079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:51.393058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:51.522592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2eed3-a81c-480c-9329-b8b68b248344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:51.525784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2eed3-a81c-480c-9329-b8b68b248344 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.527240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2eed3-a81c-480c-9329-b8b68b248344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.528505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2eed3-a81c-480c-9329-b8b68b248344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:51.529702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2eed3-a81c-480c-9329-b8b68b248344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:51.531484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:51.540589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2eed3-a81c-480c-9329-b8b68b248344 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:51.587459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88580-9bb0-4327-8ace-220b38a95449 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:51.598993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 860/1743] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:22:51.600393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ac0d4-8e90-4819-9267-1f18a285eaf7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.605581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ac0d4-8e90-4819-9267-1f18a285eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.606702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ac0d4-8e90-4819-9267-1f18a285eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:51.624162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:51.624824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.625101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.625861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:51.634532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:51.746497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f20ac0d4-8e90-4819-9267-1f18a285eaf7 None None] MFA Rules not processed for user `4cc14630ede646698bb19f803e9952ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:51.752709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f20ac0d4-8e90-4819-9267-1f18a285eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:51.813310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:51.818466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:51.849824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 884/1744] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:22:51.851236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:51.872512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82956198-ddf0-4dd8-a2dc-b7f583ffe89e service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:51.897021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9ee11-acfe-40eb-bda1-da82dd16ca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:51.900496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ee11-acfe-40eb-bda1-da82dd16ca3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.904270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ee11-acfe-40eb-bda1-da82dd16ca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.904724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9ee11-acfe-40eb-bda1-da82dd16ca3f admin admin] PATH_INFO: `/v3/projects/d50449de3b3e40fe8341abf4d10d1929/users/3d403ca9ac23460289e69931936fa9ad/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:51.915529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9ee11-acfe-40eb-bda1-da82dd16ca3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50449de3b3e40fe8341abf4d10d1929, user_id=3d403ca9ac23460289e69931936fa9ad, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:51.927794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9ee11-acfe-40eb-bda1-da82dd16ca3f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:51.977772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 885/1745] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:22:51 2022] PUT /identity/v3/projects/d50449de3b3e40fe8341abf4d10d1929/users/3d403ca9ac23460289e69931936fa9ad/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:51.984714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:51.985025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:51.985325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:52.075849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] MFA Rules not processed for user `3d403ca9ac23460289e69931936fa9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:52.078866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:52.146865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 861/1746] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:52.146865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44fb4-daeb-4596-8f1d-dd5b7ca71f6a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:52.150680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44fb4-daeb-4596-8f1d-dd5b7ca71f6a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:52.150680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44fb4-daeb-4596-8f1d-dd5b7ca71f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:52.341699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-63d44fb4-daeb-4596-8f1d-dd5b7ca71f6a None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:52.353893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-63d44fb4-daeb-4596-8f1d-dd5b7ca71f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:52.374388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:52.429071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 886/1747] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:52.438966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:52.440586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:52.590356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 862/1748] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:22:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:52.597989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:52.598677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:52.598677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:52.661398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b45d05-f46f-4313-8b00-f3b6edfe2560 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:52.671439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] MFA Rules not processed for user `642764a1a825436bb4912e33f2cb4135`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:52.673038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:52.677583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:52.678725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:52.678725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:52.678981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:52.720779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:52.722393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:52.755356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 887/1749] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:22:52.881734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 863/1750] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:22:52.934359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:52.936501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:52.941284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:53.139537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78670e1c-9014-4bef-8980-be001e56b747 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:53.150287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa53f6-2e59-4587-a204-86cdf54b5d85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:53.152352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa53f6-2e59-4587-a204-86cdf54b5d85 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:53.153254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa53f6-2e59-4587-a204-86cdf54b5d85 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:53.153785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa53f6-2e59-4587-a204-86cdf54b5d85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:53.199261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa53f6-2e59-4587-a204-86cdf54b5d85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:53.204157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa53f6-2e59-4587-a204-86cdf54b5d85 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:53.296770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 888/1751] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:22:53.420060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:53.712973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6973de-5afd-42f0-96c2-5de0b7cb2b8b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:53.725893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:53.726977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:53.727753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:53.728195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] PATH_INFO: `/v3/users/3b1f22adafa94c14a974f4abac331418` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:53.730296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1f22adafa94c14a974f4abac331418)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:53.741795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:53.896948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1f22adafa94c14a974f4abac331418'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:53.898985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1f22adafa94c14a974f4abac331418'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:53.914406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:53.924698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1f22adafa94c14a974f4abac331418'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:53.979661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1f22adafa94c14a974f4abac331418'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:53.987236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1f22adafa94c14a974f4abac331418'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:54.044515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 864/1752] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:53 2022] DELETE /identity/v3/users/3b1f22adafa94c14a974f4abac331418 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:54.049956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f356-be93-4bab-a2c4-3dd8cca9782d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:54.050477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f356-be93-4bab-a2c4-3dd8cca9782d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:54.050586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f356-be93-4bab-a2c4-3dd8cca9782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:54.087774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2b74f356-be93-4bab-a2c4-3dd8cca9782d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:54.089485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2b74f356-be93-4bab-a2c4-3dd8cca9782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:54.311631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 889/1753] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:54.369272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:54.370773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:54.578403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a12f9-6538-4cc3-9be3-86b3755f42bb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:54.594419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:54.595345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:54.597289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:54.598698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:54.626090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:54.630560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:54.663301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 865/1754] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:55.584287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:55.587337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:55.587337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:55.726499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:55.733793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:55.748278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 890/1755] 10.222.0.86 () {58 vars in 1015 bytes} [Mon Aug 29 23:22:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:22:55.894015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:55.895604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:55.924008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62cfe-3f8e-45e2-8786-5ae4d9fc14ff service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:55.955066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:55.957551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:55.963167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:55.963899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:56.004642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:56.018964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:56.093681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 866/1756] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:22:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:22:57.032231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:57.035202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:57.084506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69876b-eb58-442f-ba73-b690dd14ce13 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:57.099443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:57.100274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:57.100663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:57.101074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] PATH_INFO: `/v3/projects/b3b9ba90fa524cca8df926631e149a61` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:57.115338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b9ba90fa524cca8df926631e149a61)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:57.118438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:57.369904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b9ba90fa524cca8df926631e149a61', 'request_id': 'req-00370537-7a34-474d-b4b9-2ab63cda632d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:57.400372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b9ba90fa524cca8df926631e149a61', 'request_id': 'req-00370537-7a34-474d-b4b9-2ab63cda632d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:57.407475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:57.418801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b9ba90fa524cca8df926631e149a61', 'request_id': 'req-00370537-7a34-474d-b4b9-2ab63cda632d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:57.461093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] The token cache is being invalidate because project b3b9ba90fa524cca8df926631e149a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:22:57.464792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:57.466114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-00370537-7a34-474d-b4b9-2ab63cda632d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:57.475242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 891/1757] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:57 2022] DELETE /identity/v3/projects/b3b9ba90fa524cca8df926631e149a61 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:57.475702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:57.515767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b51d01-6c22-4996-9319-b5c3bd5b4fcd service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:22:57.730538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:22:57.731913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:57.732336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:57.733004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] PATH_INFO: `/v3/users/3d403ca9ac23460289e69931936fa9ad` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:57.735303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d403ca9ac23460289e69931936fa9ad)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:22:57.739539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:22:57.983554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d403ca9ac23460289e69931936fa9ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:57.986900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d403ca9ac23460289e69931936fa9ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:58.013807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d403ca9ac23460289e69931936fa9ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:58.021947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:22:58.043000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d403ca9ac23460289e69931936fa9ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:58.044764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fd928bb7-eb81-4175-89b3-3846616e17b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d403ca9ac23460289e69931936fa9ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:22:58.084618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 867/1758] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:22:57 2022] DELETE /identity/v3/users/3d403ca9ac23460289e69931936fa9ad => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:22:59.729782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43753f-e186-4330-8b73-c4e759f7259f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:59.730693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43753f-e186-4330-8b73-c4e759f7259f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:59.731523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43753f-e186-4330-8b73-c4e759f7259f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:59.733426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 892/1759] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:22:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:22:59.758602 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:22:59.759279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:22:59.759279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:22:59.807812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:22:59.809267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:59.930600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43753f-e186-4330-8b73-c4e759f7259f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:22:59.932728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4d43753f-e186-4330-8b73-c4e759f7259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:22:59.998704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 868/1760] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:22:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:00.023588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:00.026225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:00.063016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bd708-014a-4048-9e72-6b865fd0e9a5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:00.082609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb4e4b-0c8d-4355-9955-700a9d8f8afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:00.083528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4e4b-0c8d-4355-9955-700a9d8f8afb service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:00.084160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4e4b-0c8d-4355-9955-700a9d8f8afb service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:00.085210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb4e4b-0c8d-4355-9955-700a9d8f8afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:00.116675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4e4b-0c8d-4355-9955-700a9d8f8afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:00.121927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb4e4b-0c8d-4355-9955-700a9d8f8afb service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:00.145010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43753f-e186-4330-8b73-c4e759f7259f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:00.156484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 869/1761] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:00.182214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:00.182887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:00.183176 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:00.183457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] PATH_INFO: `/v3/projects/d50449de3b3e40fe8341abf4d10d1929` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:00.185808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50449de3b3e40fe8341abf4d10d1929)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:00.187778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:00.450214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50449de3b3e40fe8341abf4d10d1929', 'request_id': 'req-71d9035d-6fb9-4d79-a130-968a5905ec2f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:00.463798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50449de3b3e40fe8341abf4d10d1929', 'request_id': 'req-71d9035d-6fb9-4d79-a130-968a5905ec2f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:00.495489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50449de3b3e40fe8341abf4d10d1929', 'request_id': 'req-71d9035d-6fb9-4d79-a130-968a5905ec2f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:00.513418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] The token cache is being invalidate because project d50449de3b3e40fe8341abf4d10d1929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:00.513714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:00.516115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-71d9035d-6fb9-4d79-a130-968a5905ec2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:00.525600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 893/1762] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:22:59 2022] DELETE /identity/v3/projects/d50449de3b3e40fe8341abf4d10d1929 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:00.527339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:00.527680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:00.528045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:00.603905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:00.605761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:00.903672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 870/1763] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:00.913620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:00.914170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:00.914284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:00.987555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:00.988815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:01.022283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 894/1764] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:01.027741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.042531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82787e99-00ed-403b-970a-d0ae88d3d450 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:01.055971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:01.056627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.056903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.057899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.058603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:01.058908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:01.060590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:01.097408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 871/1765] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:01.103943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.118163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce864-df49-465b-98e8-97f05ed1cdbe None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:01.130959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:01.131599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.131873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.132143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.132793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:01.138469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:01.223191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 895/1766] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:01 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:01.229915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.246444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4013c0f-8682-462a-b4ba-695343963390 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:01.353683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:01.401478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5c824-745d-46e1-a9e4-9fe6e739c3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:01.402281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5c824-745d-46e1-a9e4-9fe6e739c3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.402561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5c824-745d-46e1-a9e4-9fe6e739c3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.402944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5c824-745d-46e1-a9e4-9fe6e739c3b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.403685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5c824-745d-46e1-a9e4-9fe6e739c3b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:01.406067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5c824-745d-46e1-a9e4-9fe6e739c3b2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:01.448315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.460873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 872/1767] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:01 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:01.488320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0850e-b13e-4006-8313-62f88f09dbee admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:01.496998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:01.508338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c43c2-a0ef-4bd6-851e-1cc4342f9b14 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.508915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c43c2-a0ef-4bd6-851e-1cc4342f9b14 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.509436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c43c2-a0ef-4bd6-851e-1cc4342f9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.512469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.514052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.516908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.518125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:01.520976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:01.547323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 896/1768] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:01.548693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-163c43c2-a0ef-4bd6-851e-1cc4342f9b14 None None] MFA Rules not processed for user `55c184b749004ac298bb634bc948c537`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:01.550203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-163c43c2-a0ef-4bd6-851e-1cc4342f9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:01.553056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.572439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacbbf-52ee-49f4-8642-fbe55af34bc3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:01.580630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:01.582017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.582611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.583112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.584039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:01.585923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:01.606216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 897/1769] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:01.610261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.627572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29e72-b17e-4209-9f92-b80ab7320d61 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:01.635581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:01.636253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.637051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.637377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] PATH_INFO: `/v3/projects/1ab7d757309b4a08a2d15be88b1653f0/users/109e74d8a7294e29aeda603c748a8a6b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.661170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab7d757309b4a08a2d15be88b1653f0, user_id=109e74d8a7294e29aeda603c748a8a6b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:01.665564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:01.667835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 873/1770] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:01.708836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 898/1771] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:01 2022] PUT /identity/v3/projects/1ab7d757309b4a08a2d15be88b1653f0/users/109e74d8a7294e29aeda603c748a8a6b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:01.710167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:01.710459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:01.710740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:01.793985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] MFA Rules not processed for user `109e74d8a7294e29aeda603c748a8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:01.795862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:01.881306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 874/1772] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:01.886213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:01.893696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:02.029376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc653a-2a3f-45d8-992a-75ed456d9b9f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:02.046024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:02.047091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.047380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.047657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.048913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:02.052435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:02.121148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 899/1773] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:01 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:02.122032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:02.144834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078874e3-8bbd-4ecf-9c5a-f7c9a906747b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:02.324545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:02.325519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.325807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.326236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.328049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:02.337527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:02.366730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:02.384385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 875/1774] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:02 2022] POST /identity/v3/users => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:02.385772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:02.403923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a7558-eef6-458b-9511-8a68a4b0cea9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:02.432257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:02.432887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.433190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.433468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.434228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:02.435921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:02.456366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 900/1775] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:02.460584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:02.481446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45702bb-8e12-477b-bbc7-d7febd2f65a4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:02.486343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:02.487025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.487303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.487572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] PATH_INFO: `/v3/projects/b63c172f77374711b6f95f098d568a3d/users/74e02ee15f3c45b8aa64a4fecd00b0ad/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.525976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63c172f77374711b6f95f098d568a3d, user_id=74e02ee15f3c45b8aa64a4fecd00b0ad, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:02.528650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:02.552840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 876/1776] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:02 2022] PUT /identity/v3/projects/b63c172f77374711b6f95f098d568a3d/users/74e02ee15f3c45b8aa64a4fecd00b0ad/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:02.557004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:02.573817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f6e08-6b58-410c-b7a2-499665194fef admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:02.704388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98242449-26c1-41a2-831c-0bf976cdb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:02.705018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242449-26c1-41a2-831c-0bf976cdb0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.705329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242449-26c1-41a2-831c-0bf976cdb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.705616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98242449-26c1-41a2-831c-0bf976cdb0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.706252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98242449-26c1-41a2-831c-0bf976cdb0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:02.707857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98242449-26c1-41a2-831c-0bf976cdb0c9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:02.731510 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 901/1777] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:02.736164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:02.750008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a681f6c-18e7-4c58-ba98-459fbedc53d4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:02.761356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:02.762028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.762306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.762580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] PATH_INFO: `/v3/projects/b63c172f77374711b6f95f098d568a3d/users/74e02ee15f3c45b8aa64a4fecd00b0ad/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.770092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63c172f77374711b6f95f098d568a3d, user_id=74e02ee15f3c45b8aa64a4fecd00b0ad, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:02.772832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:02.798682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 877/1778] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:02 2022] PUT /identity/v3/projects/b63c172f77374711b6f95f098d568a3d/users/74e02ee15f3c45b8aa64a4fecd00b0ad/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:02.812097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:02.812415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:02.812649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:02.892412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] MFA Rules not processed for user `74e02ee15f3c45b8aa64a4fecd00b0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:02.893609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:03.115373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:03.130656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 902/1779] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:03.192557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:03.198055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:03.359162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d2dab-2e85-4713-9bd8-487af518088b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:03.379936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe125aa3-61b9-41ab-b511-ccfd418c1a91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:03.381028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe125aa3-61b9-41ab-b511-ccfd418c1a91 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:03.381519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe125aa3-61b9-41ab-b511-ccfd418c1a91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:03.381999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe125aa3-61b9-41ab-b511-ccfd418c1a91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:03.416456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe125aa3-61b9-41ab-b511-ccfd418c1a91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:03.418334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe125aa3-61b9-41ab-b511-ccfd418c1a91 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:03.455156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 878/1780] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:03.670590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:03.690696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d22ab-7e2e-4487-b5e2-297dea3f2a0e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:03.695780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647ec4f-c21e-42ca-bf38-a27e6caff1a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:03.696962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647ec4f-c21e-42ca-bf38-a27e6caff1a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:03.697072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647ec4f-c21e-42ca-bf38-a27e6caff1a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:03.697387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647ec4f-c21e-42ca-bf38-a27e6caff1a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:03.888110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647ec4f-c21e-42ca-bf38-a27e6caff1a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:03.893200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647ec4f-c21e-42ca-bf38-a27e6caff1a3 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:03.946276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 903/1781] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:04.249306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078b90-3d46-48ca-8d72-e17e3d0b90a7 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:04.251008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078b90-3d46-48ca-8d72-e17e3d0b90a7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:04.251455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49078b90-3d46-48ca-8d72-e17e3d0b90a7 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:04.253509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 879/1782] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:23:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:23:04.278406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:04.279342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:04.282201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:04.380594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:04.384497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:04.658875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 904/1783] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:23:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:04.676143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49078b90-3d46-48ca-8d72-e17e3d0b90a7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:04.678220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-49078b90-3d46-48ca-8d72-e17e3d0b90a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:04.728874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49078b90-3d46-48ca-8d72-e17e3d0b90a7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:04.775927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:04.778122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:04.780931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:04.782167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:04.811803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:04.815117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:04.874060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 880/1784] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:05.152743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:05.434579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dfb56-d27e-4f41-a6ad-3b8bb94b8d6e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:05.450175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:05.451290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:05.451713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:05.452138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] PATH_INFO: `/v3/users/109e74d8a7294e29aeda603c748a8a6b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:05.453574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=109e74d8a7294e29aeda603c748a8a6b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:05.455651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:05.514698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:05.550525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109e74d8a7294e29aeda603c748a8a6b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:05.561165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109e74d8a7294e29aeda603c748a8a6b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:05.611022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109e74d8a7294e29aeda603c748a8a6b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:05.655861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109e74d8a7294e29aeda603c748a8a6b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:05.657327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-243febb4-b698-416a-889a-618ba27e4e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109e74d8a7294e29aeda603c748a8a6b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:05.705037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:05.707110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:05.707936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 905/1785] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:05 2022] DELETE /identity/v3/users/109e74d8a7294e29aeda603c748a8a6b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:05.714443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:05.714820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:05.715102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:05.742905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f02ba-7b1e-4b22-b2a7-96d9bdde3729 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:05.745420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:05.746714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:05.840576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 906/1786] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:05.848504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:05.851244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:05.981395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:05.981395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:05.981395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:05.981395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] PATH_INFO: `/v3/users/0e8ce52d919e4d2d8abac2139a7e78c8` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:05.986016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8ce52d919e4d2d8abac2139a7e78c8)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:05.989910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:06.025771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d8400-9509-4dd4-9c17-dd69d64122fc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:06.045152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200f833-7c54-4cdf-944d-ccdbee6dfff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:06.049400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f833-7c54-4cdf-944d-ccdbee6dfff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:06.053636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f833-7c54-4cdf-944d-ccdbee6dfff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:06.063853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200f833-7c54-4cdf-944d-ccdbee6dfff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:06.112139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f833-7c54-4cdf-944d-ccdbee6dfff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:06.121689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200f833-7c54-4cdf-944d-ccdbee6dfff2 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:06.163088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8ce52d919e4d2d8abac2139a7e78c8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:06.166393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8ce52d919e4d2d8abac2139a7e78c8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:06.172094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:06.172698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 907/1787] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:06.180680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8ce52d919e4d2d8abac2139a7e78c8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:06.212917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8ce52d919e4d2d8abac2139a7e78c8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:06.213908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8ce52d919e4d2d8abac2139a7e78c8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:06.245927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 881/1788] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:05 2022] DELETE /identity/v3/users/0e8ce52d919e4d2d8abac2139a7e78c8 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:06.250392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:06.250990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:06.251503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:06.320125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:06.324527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:06.460447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:06.511030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 908/1789] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:06.557019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:06.558822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:06.784522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef750c5-fdc1-4d8f-826d-df7eb05ff34b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:06.795338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:06.796289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:06.796784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:06.797334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:06.823422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:06.825903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:06.848107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 882/1790] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:07.587084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:07.588858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:07.615111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127169b-c1d7-426d-9d69-c1da60b01811 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:07.628463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:07.629308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:07.629593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:07.630054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] PATH_INFO: `/v3/projects/1ab7d757309b4a08a2d15be88b1653f0` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:07.631278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab7d757309b4a08a2d15be88b1653f0)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:07.635818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:07.720065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab7d757309b4a08a2d15be88b1653f0', 'request_id': 'req-7c91af1c-460f-490e-8af6-d0ee11767077'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:07.726376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab7d757309b4a08a2d15be88b1653f0', 'request_id': 'req-7c91af1c-460f-490e-8af6-d0ee11767077'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:07.738303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab7d757309b4a08a2d15be88b1653f0', 'request_id': 'req-7c91af1c-460f-490e-8af6-d0ee11767077'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:07.763126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] The token cache is being invalidate because project 1ab7d757309b4a08a2d15be88b1653f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:07.763440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:07.764259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:07.769347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 909/1791] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:07 2022] DELETE /identity/v3/projects/1ab7d757309b4a08a2d15be88b1653f0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:07.769891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:07.794735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da55d2-a457-4c05-839c-a9de8b4c7ec9 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:07.971190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:07.971970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:07.972349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:07.972627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] PATH_INFO: `/v3/users/74e02ee15f3c45b8aa64a4fecd00b0ad` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:07.974662 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e02ee15f3c45b8aa64a4fecd00b0ad)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:07.977351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:08.072192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e02ee15f3c45b8aa64a4fecd00b0ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.073234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e02ee15f3c45b8aa64a4fecd00b0ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.104499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e02ee15f3c45b8aa64a4fecd00b0ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.141679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e02ee15f3c45b8aa64a4fecd00b0ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.145278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e02ee15f3c45b8aa64a4fecd00b0ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.154331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:08.203715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 883/1792] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:07 2022] DELETE /identity/v3/users/74e02ee15f3c45b8aa64a4fecd00b0ad => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:08.378105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:08.380048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:08.434547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91af1c-460f-490e-8af6-d0ee11767077 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:08.627289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:08.628836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:08.630629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:08.631075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] PATH_INFO: `/v3/projects/3a51ab6b7d3442ba9effaa98f0327e76` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:08.635943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a51ab6b7d3442ba9effaa98f0327e76)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:08.640736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:08.724110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a51ab6b7d3442ba9effaa98f0327e76', 'request_id': 'req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.731595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a51ab6b7d3442ba9effaa98f0327e76', 'request_id': 'req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.741687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a51ab6b7d3442ba9effaa98f0327e76', 'request_id': 'req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.760543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] The token cache is being invalidate because project 3a51ab6b7d3442ba9effaa98f0327e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:08.760858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.761833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.764333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 910/1793] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:08 2022] DELETE /identity/v3/projects/3a51ab6b7d3442ba9effaa98f0327e76 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:08.768022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:08.769549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:08.793686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5b933-61c9-4484-a273-2f3eb682fae6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:08.880434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:08.881197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:08.885771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:08.886496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] PATH_INFO: `/v3/users/d9204756537e4bc18249afe880f75055` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:08.888096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9204756537e4bc18249afe880f75055)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:08.891514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:08.950359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9204756537e4bc18249afe880f75055'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.951214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9204756537e4bc18249afe880f75055'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.960645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9204756537e4bc18249afe880f75055'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.976486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9204756537e4bc18249afe880f75055'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.978308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-722e3e26-cb44-4372-8343-6f4a5ddfc772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9204756537e4bc18249afe880f75055'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:08.995545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 884/1794] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:08 2022] DELETE /identity/v3/users/d9204756537e4bc18249afe880f75055 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:09.736423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:09.737967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:09.761364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a01a8c-e618-42de-8d6c-1090ff6ff3c1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:09.771592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:09.883504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:09.884686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:09.884967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:09.885310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] PATH_INFO: `/v3/projects/b63c172f77374711b6f95f098d568a3d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:09.886472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63c172f77374711b6f95f098d568a3d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:09.888421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:09.952271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63c172f77374711b6f95f098d568a3d', 'request_id': 'req-b514d499-6268-4497-87be-722e512b7d22'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:09.963818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63c172f77374711b6f95f098d568a3d', 'request_id': 'req-b514d499-6268-4497-87be-722e512b7d22'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:09.980681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63c172f77374711b6f95f098d568a3d', 'request_id': 'req-b514d499-6268-4497-87be-722e512b7d22'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:09.999612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] The token cache is being invalidate because project b63c172f77374711b6f95f098d568a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:09.999828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.000947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.002910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 911/1795] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:09 2022] DELETE /identity/v3/projects/b63c172f77374711b6f95f098d568a3d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:10.007948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a491b-ad1d-464e-b671-f5ecf9ec99d4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.008410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a491b-ad1d-464e-b671-f5ecf9ec99d4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.008907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a491b-ad1d-464e-b671-f5ecf9ec99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.040860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-404a491b-ad1d-464e-b671-f5ecf9ec99d4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:10.042396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-404a491b-ad1d-464e-b671-f5ecf9ec99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.051408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.053549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.137558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514d499-6268-4497-87be-722e512b7d22 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.143029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.143706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.143981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.144261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] PATH_INFO: `/v3/projects/663432540bfc4d55bf896f2d7f1b4720` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.145448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663432540bfc4d55bf896f2d7f1b4720)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.147446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.161527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 885/1796] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:10.169441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.169869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.170159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.193927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:10.195324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.200876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:10.201684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:10.220350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663432540bfc4d55bf896f2d7f1b4720', 'request_id': 'req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.228254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663432540bfc4d55bf896f2d7f1b4720', 'request_id': 'req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.238470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663432540bfc4d55bf896f2d7f1b4720', 'request_id': 'req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.256378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] The token cache is being invalidate because project 663432540bfc4d55bf896f2d7f1b4720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:10.256700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.257420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0eff9ecc-35be-41e0-bdb9-3e8311b6db83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:10.259394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 912/1797] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:10 2022] DELETE /identity/v3/projects/663432540bfc4d55bf896f2d7f1b4720 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:10.263953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d843e-b675-461e-9e1b-5aaf7f2c4b89 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.264243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d843e-b675-461e-9e1b-5aaf7f2c4b89 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.264521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d843e-b675-461e-9e1b-5aaf7f2c4b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.274693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 886/1798] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:10.279047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.287434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-747d843e-b675-461e-9e1b-5aaf7f2c4b89 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:10.288177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18990bce-c1cd-45b5-9592-a53b3973583c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.288648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-747d843e-b675-461e-9e1b-5aaf7f2c4b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.297472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 913/1799] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:10.297998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.298856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.299321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.299788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.300669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:10.301139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.303248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.305453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.305923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.306657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.324873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 887/1800] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:23:10.326094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.327834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:10.329073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.347582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5929446-0865-469c-abab-136ea762bad0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.353965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 914/1801] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:10.354143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.354612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.354877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.354997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.355162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.355912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.358266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.372216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb8c1-c790-442e-b6a5-7377722512e8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.381736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.382567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.382858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.383267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.384340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:10.384459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.386204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.389867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 888/1802] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:10.393837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.405391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 915/1803] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:10.406459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.416915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b9baf-d579-425d-a92e-7b88bb46267f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.458370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06fb63-d358-42e3-b157-4641cb7c5705 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.464022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.464628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.464905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.465211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.465829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.467767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.474322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.474932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.475213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.475484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.476109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.478553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.491503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 889/1804] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:10.493207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.503003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147296d1-561e-47cc-a2ac-425170ba652d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.509748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 916/1805] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:10.509907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.509907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.509907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.509907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.510224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.510909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.511206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.525143 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 890/1806] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:10.526406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.536296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e886c-35be-4c5e-895a-dd87371e0484 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.578885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e944-d838-4013-9486-be24dbe64345 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.585446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.586104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.586395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.586660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.587415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.588378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:10.589388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.600893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.602284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.602562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.602908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.603597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.605320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.611550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 917/1807] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:10.615462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.618053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 891/1808] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:10.622063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.631923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197b9d-4111-4060-ae56-f007e3a74c04 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.632465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279680-7e7d-4646-8212-b6bbe7c815d5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.637397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c415eac-f3f2-46da-9b62-c3dc48a697c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.637780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.638194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c415eac-f3f2-46da-9b62-c3dc48a697c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.638390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.638486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c415eac-f3f2-46da-9b62-c3dc48a697c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.638682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.638787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c415eac-f3f2-46da-9b62-c3dc48a697c2 admin admin] PATH_INFO: `/v3/projects/1b8255e8a7a244ca88b80f9005c50636/users/09d9ac68a7214c299a275429189a4c38/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.638937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.639572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.641201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.652081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 918/1809] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:10.656282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.657975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c415eac-f3f2-46da-9b62-c3dc48a697c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8255e8a7a244ca88b80f9005c50636, user_id=09d9ac68a7214c299a275429189a4c38, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.661782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c415eac-f3f2-46da-9b62-c3dc48a697c2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.662818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:10.667969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441a593-fc26-4ee6-b905-a36313575a49 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.674477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.675097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.675539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.676067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.676709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.676888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 892/1810] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:10 2022] PUT /identity/v3/projects/1b8255e8a7a244ca88b80f9005c50636/users/09d9ac68a7214c299a275429189a4c38/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:10.678599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.690036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 919/1811] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:10.694780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.696363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.697011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.698013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.710366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96b727-9974-4d85-8c35-185b75694bd6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:10.740376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] MFA Rules not processed for user `09d9ac68a7214c299a275429189a4c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:10.742387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.779498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fcf6c-3e70-4c00-a9de-92eb8d3a0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:10.780177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fcf6c-3e70-4c00-a9de-92eb8d3a0771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.780453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fcf6c-3e70-4c00-a9de-92eb8d3a0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.780722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fcf6c-3e70-4c00-a9de-92eb8d3a0771 admin admin] PATH_INFO: `/v3/projects/fd5a7317cc214722a08759e760a05a2f/users/99deee62218541a9a89badc4fe6a9e54/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.797509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fcf6c-3e70-4c00-a9de-92eb8d3a0771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5a7317cc214722a08759e760a05a2f, user_id=99deee62218541a9a89badc4fe6a9e54, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:10.800243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fcf6c-3e70-4c00-a9de-92eb8d3a0771 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:10.817530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 920/1812] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:10 2022] PUT /identity/v3/projects/fd5a7317cc214722a08759e760a05a2f/users/99deee62218541a9a89badc4fe6a9e54/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:10.830835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:10.831289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:10.831633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:10.885042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] MFA Rules not processed for user `99deee62218541a9a89badc4fe6a9e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:10.888174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:10.920537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 893/1813] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:10.938260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:10.940120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:11.038016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 921/1814] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:11.038938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.121924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e77f0-3260-49cf-bd4d-96c428aaffa5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.128991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.129624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.129901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.130168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.130995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.133237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.150028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:11.158626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e3418-e03f-49b2-b132-13c6db917582 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.197785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 922/1815] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:11 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:11.200212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.250204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.250946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.251236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.251844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.341726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:11.376603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d96fb-9b64-4a7f-94e2-85a7ed1f8366 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.400267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.401018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.401303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.401590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.402241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.406516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.449269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.455206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.463574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 923/1816] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:11 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:11.468082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.482919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 894/1817] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:11.485875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daa255-8e3c-4701-b689-4284170191c3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.490681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.491310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.492404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.492689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.493426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.495875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.506353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.514419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 924/1818] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:11.518012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.529154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0123-76d0-4d2d-b524-319db8ea8efd service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.535131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b8029-63bd-4a5d-9774-177403f9189d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.536484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.537515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.537973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.538449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] PATH_INFO: `/v3/users/09d9ac68a7214c299a275429189a4c38` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.541258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d9ac68a7214c299a275429189a4c38)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.543486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.544588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.545330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.545727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.546217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] PATH_INFO: `/v3/projects/bb100970fc0b4c6197610d0d6942c525/users/00cf0a1629c84fd0bf82df386ff1bd47/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.568284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb100970fc0b4c6197610d0d6942c525, user_id=00cf0a1629c84fd0bf82df386ff1bd47, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.577894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.610851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 925/1819] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:11 2022] PUT /identity/v3/projects/bb100970fc0b4c6197610d0d6942c525/users/00cf0a1629c84fd0bf82df386ff1bd47/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:11.615427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.636151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d9ac68a7214c299a275429189a4c38'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:11.637018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d9ac68a7214c299a275429189a4c38'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:11.652809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d9ac68a7214c299a275429189a4c38'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:11.676465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d9ac68a7214c299a275429189a4c38'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:11.678098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4bb5b618-69da-433c-a90d-799b3d05197a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d9ac68a7214c299a275429189a4c38'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:11.701826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 895/1820] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:11 2022] DELETE /identity/v3/users/09d9ac68a7214c299a275429189a4c38 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:11.703627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.703936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.704218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.725654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb73d-bd49-44ff-a326-2cb90893f0cc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.731728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:11.733566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:11.797856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:11.811497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.813010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.813474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.813898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.814521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 896/1821] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:11.814919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.816961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.830493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 926/1822] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:11.834790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.836835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:11.837430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:11.839248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:11.852388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16610ebf-793a-4e62-a21b-ade39e15d7c8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.858472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52003-a7bf-46fa-a254-d4ddd66c7d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:11.859485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52003-a7bf-46fa-a254-d4ddd66c7d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.859845 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52003-a7bf-46fa-a254-d4ddd66c7d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.860193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52003-a7bf-46fa-a254-d4ddd66c7d9c admin admin] PATH_INFO: `/v3/projects/bb100970fc0b4c6197610d0d6942c525/users/00cf0a1629c84fd0bf82df386ff1bd47/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.862565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52003-a7bf-46fa-a254-d4ddd66c7d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb100970fc0b4c6197610d0d6942c525, user_id=00cf0a1629c84fd0bf82df386ff1bd47, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:11.865643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52003-a7bf-46fa-a254-d4ddd66c7d9c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:11.891244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 897/1823] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:11 2022] PUT /identity/v3/projects/bb100970fc0b4c6197610d0d6942c525/users/00cf0a1629c84fd0bf82df386ff1bd47/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:11.893177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:11.893710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:11.894164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:11.935872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] MFA Rules not processed for user `00cf0a1629c84fd0bf82df386ff1bd47`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:11.937099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:11.947782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7dcca-d864-477e-b1de-227a358b27f1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:11.970361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:12.025268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:12.026242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:12.026704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:12.027157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:12.087933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 898/1824] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:12.098644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:12.100584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:12.125345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:12.127022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:12.141132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 927/1825] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:12.192440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce2875-2112-422c-aa26-9d7a245621c9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:12.197539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:12.198239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:12.205561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:12.206386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:12.227958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:12.229852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:12.245311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 899/1826] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:12.348739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:12.366410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17fc84-c426-4587-8111-6bad413a7adc service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:12.373871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:12.375000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:12.375529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:12.376059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:12.378810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:12.472799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:12.484656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:12.486264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53e402-591a-4de9-af1b-c7574aecfeea service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:12.513686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 928/1827] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:13.474637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:13.476113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:13.491900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015808f-dfbb-448e-b089-47c98a3e2ef4 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:13.499458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:13.500266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:13.500449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:13.500723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] PATH_INFO: `/v3/projects/1b8255e8a7a244ca88b80f9005c50636` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:13.502112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8255e8a7a244ca88b80f9005c50636)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:13.504299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:13.595168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8255e8a7a244ca88b80f9005c50636', 'request_id': 'req-15d4c92f-bf55-454d-9914-80fb87b53274'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:13.608719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8255e8a7a244ca88b80f9005c50636', 'request_id': 'req-15d4c92f-bf55-454d-9914-80fb87b53274'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:13.616646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8255e8a7a244ca88b80f9005c50636', 'request_id': 'req-15d4c92f-bf55-454d-9914-80fb87b53274'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:13.641758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] The token cache is being invalidate because project 1b8255e8a7a244ca88b80f9005c50636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:13.642059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:13.643141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-15d4c92f-bf55-454d-9914-80fb87b53274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:13.647337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 900/1828] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:13 2022] DELETE /identity/v3/projects/1b8255e8a7a244ca88b80f9005c50636 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:13.652104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:13.652607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:13.652686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:13.687758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:13.689002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:13.853970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:13.854208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 929/1829] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:13.854423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:13.854775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:13.892128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:13.893473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:13.903247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 901/1830] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:13.907568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:13.939455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1508f-f64f-464f-a5a2-3cc58148f826 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:13.951386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:13.952018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:13.952436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:13.952719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:13.953838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:13.953838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:13.955466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.025839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.037534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 930/1831] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:14.040768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a68319-6a8b-4c03-b767-2a19dd50b56f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.053032 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.053880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.054524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.055819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.056783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.064541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.126515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 902/1832] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:14 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:14.128221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.145317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35858ee5-176b-468e-8ec2-236498703be6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.249438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.262236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.262236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.262236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.262236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.262236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.297356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 931/1833] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:14 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:14.319257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.334110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb4d9f-f212-495f-b669-cbc30d2becad admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.339539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.340515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.340806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.341086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.341775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.343434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.346091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:14.358289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 903/1834] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:14.362882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.384551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa58a70-0280-4ebb-a843-2a2cc553b20f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.390570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a110897-9189-4f00-b802-20e32bc4e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.391198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a110897-9189-4f00-b802-20e32bc4e62d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.391598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a110897-9189-4f00-b802-20e32bc4e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.391953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a110897-9189-4f00-b802-20e32bc4e62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.392834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a110897-9189-4f00-b802-20e32bc4e62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.395159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a110897-9189-4f00-b802-20e32bc4e62d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.410078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 932/1835] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:14.413981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.430074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73838669-5e10-4a3c-9988-081571b83482 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.437946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.438898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.439480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.440894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] PATH_INFO: `/v3/projects/c5b7e4bb8e644ec6a5b585e28c10c969/users/3df2ff0884de4d26a8a79a114fb3e7c5/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.462314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b7e4bb8e644ec6a5b585e28c10c969, user_id=3df2ff0884de4d26a8a79a114fb3e7c5, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.465609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.490023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 904/1836] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:14 2022] PUT /identity/v3/projects/c5b7e4bb8e644ec6a5b585e28c10c969/users/3df2ff0884de4d26a8a79a114fb3e7c5/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:14.500785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.501079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.501430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.547600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] MFA Rules not processed for user `3df2ff0884de4d26a8a79a114fb3e7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:14.549087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:14.613725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:14.643485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 933/1837] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:14.647832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.713942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d596e5-8493-410b-aaab-9d2a5386672c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.719315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.719953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.720235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.720510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.721157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.723062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.749665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 905/1838] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:14 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:14.753800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.764771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff2a9-5d7c-4dce-ab8f-9ee36447a6f1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.826368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.827139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.827424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.827692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.828411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.830450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.857580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 934/1839] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:14 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:14.858789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.869344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c30a34-22ef-457f-91e2-1683e3990413 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.874179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.874825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.875100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.875443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.876010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.877655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.888731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 906/1840] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:14.892936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.909077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204916f-fc22-4a40-9489-5fe2e5e3e332 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.914424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d4c94-e676-4652-b83b-c7721f7f0cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.915051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4c94-e676-4652-b83b-c7721f7f0cce admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.915331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4c94-e676-4652-b83b-c7721f7f0cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.915610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d4c94-e676-4652-b83b-c7721f7f0cce admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.916265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d4c94-e676-4652-b83b-c7721f7f0cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.917946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d4c94-e676-4652-b83b-c7721f7f0cce admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.931369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 935/1841] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:14.935509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:14.950864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4e005-e468-4d3d-906b-b267cdb3d10f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:14.960681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:14.961650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:14.962004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:14.962378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] PATH_INFO: `/v3/projects/b532c05f3ca945c3a710a85fed057ce9/users/966f37828c1f4abc8358bf8da7781ccb/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:14.978499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b532c05f3ca945c3a710a85fed057ce9, user_id=966f37828c1f4abc8358bf8da7781ccb, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:14.981555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:14.998966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 907/1842] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:14 2022] PUT /identity/v3/projects/b532c05f3ca945c3a710a85fed057ce9/users/966f37828c1f4abc8358bf8da7781ccb/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:15.010507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.010808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.011088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.050314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] MFA Rules not processed for user `966f37828c1f4abc8358bf8da7781ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:15.051571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:15.118619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 936/1843] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:15.123098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.184726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8227-1163-43ca-a4dd-304e1b05c31c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:15.189292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:15.189893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.190175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.190445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.191071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:15.192996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:15.220392 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 908/1844] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:15 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:15.224424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.235831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8db445-03ba-4289-a7f3-6445165f8021 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:15.285923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:15.293741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:15.294567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.294862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.295291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.296068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:15.298046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:15.322307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 937/1845] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:15 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:15.326177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.337687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7251c-7a53-4ecb-be7d-4e06724c16e7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:15.343499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:15.344120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.344401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.344679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.345369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:15.346973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:15.349363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:15.360853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 909/1846] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:15.365995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.376570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aa0bc-f3c2-4e37-85b2-730d0dc464d9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:15.381264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:15.381934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.382214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.382491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] PATH_INFO: `/v3/projects/f5f7e3cc370f45ad8430f6a096644c91/users/e559165f26894d76962de222ed26f8ce/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.399080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f7e3cc370f45ad8430f6a096644c91, user_id=e559165f26894d76962de222ed26f8ce, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:15.403167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:15.417818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 938/1847] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:15 2022] PUT /identity/v3/projects/f5f7e3cc370f45ad8430f6a096644c91/users/e559165f26894d76962de222ed26f8ce/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:15.421660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.432668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7c20a-4eef-4f4a-b480-2e01d9a8646b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:15.542420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9473e63-a7f9-4f3a-98c1-9c780bf6df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:15.543028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473e63-a7f9-4f3a-98c1-9c780bf6df72 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.543642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473e63-a7f9-4f3a-98c1-9c780bf6df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.543920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9473e63-a7f9-4f3a-98c1-9c780bf6df72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.544605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473e63-a7f9-4f3a-98c1-9c780bf6df72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:15.546764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9473e63-a7f9-4f3a-98c1-9c780bf6df72 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:15.562211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 910/1848] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:15.563363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.576123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13152fcb-2462-41db-8559-0eaa8fc76d41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:15.583425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:15.584126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.584394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.584677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] PATH_INFO: `/v3/projects/f5f7e3cc370f45ad8430f6a096644c91/users/e559165f26894d76962de222ed26f8ce/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.588134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f7e3cc370f45ad8430f6a096644c91, user_id=e559165f26894d76962de222ed26f8ce, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:15.591142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:15.603225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 939/1849] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:15 2022] PUT /identity/v3/projects/f5f7e3cc370f45ad8430f6a096644c91/users/e559165f26894d76962de222ed26f8ce/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:15.613695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d961f-a889-421b-858c-4132dc08f331 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:15.613984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d961f-a889-421b-858c-4132dc08f331 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:15.614266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d961f-a889-421b-858c-4132dc08f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:15.694719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-809d961f-a889-421b-858c-4132dc08f331 None None] MFA Rules not processed for user `e559165f26894d76962de222ed26f8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:15.696790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-809d961f-a889-421b-858c-4132dc08f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:15.858342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 911/1850] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:15.921206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:15.923040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:16.029796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaeb8b1-b129-4c5c-a635-acfa2e95d836 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:16.036246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:16.036881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:16.037181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:16.037460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:16.169493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dab91-a848-4dee-9c80-74af60453eac None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:16.169920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dab91-a848-4dee-9c80-74af60453eac None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:16.170097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dab91-a848-4dee-9c80-74af60453eac None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:16.172054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 912/1851] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:23:16.178246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:16.179993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:16.197363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:16.197661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:16.197950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:16.208301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 940/1852] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:16.248346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:16.250470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:16.390077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 913/1853] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:23:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:16.405617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:16.407307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:16.426960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673654b5-5cc0-4df2-8010-c107fdc6ad19 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:16.434404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a64e0d-1846-4f1a-af5e-bac71b5c8d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:16.435036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64e0d-1846-4f1a-af5e-bac71b5c8d02 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:16.435323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64e0d-1846-4f1a-af5e-bac71b5c8d02 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:16.435635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a64e0d-1846-4f1a-af5e-bac71b5c8d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:16.446607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64e0d-1846-4f1a-af5e-bac71b5c8d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:16.448526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a64e0d-1846-4f1a-af5e-bac71b5c8d02 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:16.470270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 941/1854] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:16.575355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:16.577685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:16.595664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:16.762761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726df41-b09e-4586-b766-bf8b655d6189 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:16.769142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:16.770105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:16.771155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:16.771864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] PATH_INFO: `/v3/users/6a6a185fb2dc4a55a3211a1ca7112aaf` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:16.774712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6a185fb2dc4a55a3211a1ca7112aaf)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:16.777717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:16.838462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6a185fb2dc4a55a3211a1ca7112aaf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:16.839668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6a185fb2dc4a55a3211a1ca7112aaf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:16.847866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6a185fb2dc4a55a3211a1ca7112aaf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:16.863823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6a185fb2dc4a55a3211a1ca7112aaf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:16.864558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6a185fb2dc4a55a3211a1ca7112aaf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:16.877941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 914/1855] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:16 2022] DELETE /identity/v3/users/6a6a185fb2dc4a55a3211a1ca7112aaf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:16.882553 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:16.883875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:16.884163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:16.906298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:16.914829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:16.968882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:16.984957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 942/1856] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:16.994914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:16.996328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:17.056764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba10357-f4e9-407c-8a71-890ac6b0a764 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:17.060695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:17.061430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:17.061719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:17.061972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:17.075307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:17.076777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:17.087925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 915/1857] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:17.664034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:17.665791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:17.680497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540325-bd38-4784-be5c-83d9060ea7fc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:17.685285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:17.686030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:17.686201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:17.686479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] PATH_INFO: `/v3/projects/c0cb517b21eb410b9fed871c3ed12dd6` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:17.687603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cb517b21eb410b9fed871c3ed12dd6)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:17.689552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:17.747945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cb517b21eb410b9fed871c3ed12dd6', 'request_id': 'req-1a0405db-a511-417d-a062-7039ff43df34'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:17.757165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cb517b21eb410b9fed871c3ed12dd6', 'request_id': 'req-1a0405db-a511-417d-a062-7039ff43df34'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:17.778905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cb517b21eb410b9fed871c3ed12dd6', 'request_id': 'req-1a0405db-a511-417d-a062-7039ff43df34'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:17.792425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] The token cache is being invalidate because project c0cb517b21eb410b9fed871c3ed12dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:17.792724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:17.793431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:17.795255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 943/1858] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:17 2022] DELETE /identity/v3/projects/c0cb517b21eb410b9fed871c3ed12dd6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:17.799783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:17.814250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d4706-cbed-407e-981e-0259bcbdce89 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:17.852853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:17.883189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:17.883963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:17.884239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:17.884520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] PATH_INFO: `/v3/users/d8726fc6640748b19b5d717b7fe56dc2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:17.885698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8726fc6640748b19b5d717b7fe56dc2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:17.887631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:17.945650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:17.950098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:17.989212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8726fc6640748b19b5d717b7fe56dc2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:17.989571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8726fc6640748b19b5d717b7fe56dc2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:18.012025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8726fc6640748b19b5d717b7fe56dc2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:18.031784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8726fc6640748b19b5d717b7fe56dc2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:18.032681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8726fc6640748b19b5d717b7fe56dc2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:18.080222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0405db-a511-417d-a062-7039ff43df34 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:18.081004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 916/1859] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:17 2022] DELETE /identity/v3/users/d8726fc6640748b19b5d717b7fe56dc2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:18.194631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:18.198161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:18.199125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:18.199568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:18.216214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:18.296621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:18.319082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:18.321234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23e0e9-5d69-4f8d-818c-333bbd2268b1 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:18.345140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 944/1860] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:18.882349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:18.887808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:18.983382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed5bbf-a8c7-4e06-b53c-c1d9de248484 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:18.997012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:18.998068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:18.998501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:18.999000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] PATH_INFO: `/v3/projects/ad0a049962004a4b919596934e4248ae` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.001911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0a049962004a4b919596934e4248ae)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.025345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.149785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0a049962004a4b919596934e4248ae', 'request_id': 'req-6170b13c-352c-41ea-909f-848e0b922ecb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.156722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:19.160351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0a049962004a4b919596934e4248ae', 'request_id': 'req-6170b13c-352c-41ea-909f-848e0b922ecb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.173475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0a049962004a4b919596934e4248ae', 'request_id': 'req-6170b13c-352c-41ea-909f-848e0b922ecb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.187290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] The token cache is being invalidate because project ad0a049962004a4b919596934e4248ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:19.188010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.189016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.195424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 917/1861] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:18 2022] DELETE /identity/v3/projects/ad0a049962004a4b919596934e4248ae => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:19.196939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f3e52-4ce8-4471-a967-821d2a6c063a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.197397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f3e52-4ce8-4471-a967-821d2a6c063a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.197540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f3e52-4ce8-4471-a967-821d2a6c063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.252460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d92f3e52-4ce8-4471-a967-821d2a6c063a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:19.261694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d92f3e52-4ce8-4471-a967-821d2a6c063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:19.262990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.264923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:19.352783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170b13c-352c-41ea-909f-848e0b922ecb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.357058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.357728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.357991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.358274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.360153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:19.382564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 945/1862] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:19.390961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.391650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.392157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.438147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:19.440088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:19.459949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 946/1863] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:19.464625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.499492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e69d4-737e-4f81-a835-3bab8c2867be None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.503044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.505931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.506432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.507151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.507436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.507823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.508573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:19.508878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.511947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.520186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 918/1864] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:19.544111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 947/1865] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:23:19.548923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.564794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a14b75-5f1a-460e-83df-401d425ba347 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.579680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.580535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.580647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.580976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.582092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.583579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.640436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 919/1866] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:19 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:19.645513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.673833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd37af8-f959-4066-b797-0ee3ca8c9789 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.817279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.817279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.817279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.817279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.818124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.818124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.850617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 948/1867] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:19 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:19.855770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.870015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c3c71-0950-47ee-bc10-9011a2a3e581 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.878752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.879414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.879842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.880133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.880848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.882600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.896301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 920/1868] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:19.901028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.901940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:19.903224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.915042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a768fa-6596-4631-9939-d6db08365e2c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.920399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.929401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e38dd-2b1a-4535-8656-ff98d84dc086 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.930318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.933147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.933274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.933274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.933274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.933274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] PATH_INFO: `/v3/users/99deee62218541a9a89badc4fe6a9e54` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.934694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99deee62218541a9a89badc4fe6a9e54)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.934945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.935674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.936746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.937339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.952630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 921/1869] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:19.953704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:19.964231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65479533-cbae-4637-b118-b1c68dd2e1a8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:19.969752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c521cc0-cf7c-48a4-8c77-3a3eae38c945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:19.970524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521cc0-cf7c-48a4-8c77-3a3eae38c945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:19.970831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521cc0-cf7c-48a4-8c77-3a3eae38c945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:19.971106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521cc0-cf7c-48a4-8c77-3a3eae38c945 admin admin] PATH_INFO: `/v3/projects/140da53af2334e5a8d9de6c1538b3239/users/cce3656f8be547f1b0c2fcd003f6d7c1/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:19.987276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c521cc0-cf7c-48a4-8c77-3a3eae38c945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=140da53af2334e5a8d9de6c1538b3239, user_id=cce3656f8be547f1b0c2fcd003f6d7c1, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:19.989956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c521cc0-cf7c-48a4-8c77-3a3eae38c945 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:19.990085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99deee62218541a9a89badc4fe6a9e54'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.990672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99deee62218541a9a89badc4fe6a9e54'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:19.992673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:19.999723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99deee62218541a9a89badc4fe6a9e54'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:20.003891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 922/1870] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:19 2022] PUT /identity/v3/projects/140da53af2334e5a8d9de6c1538b3239/users/cce3656f8be547f1b0c2fcd003f6d7c1/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:20.008732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99deee62218541a9a89badc4fe6a9e54'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:20.009493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-91a14bb6-d81c-451a-b3f0-91d3f9024d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99deee62218541a9a89badc4fe6a9e54'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:20.015021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.015253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.015579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.027792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 949/1871] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:19 2022] DELETE /identity/v3/users/99deee62218541a9a89badc4fe6a9e54 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:20.032463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.032463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.032656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.046872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] MFA Rules not processed for user `cce3656f8be547f1b0c2fcd003f6d7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:20.047885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.052977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:20.054326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.062080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:20.145384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 923/1872] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:20.148105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.152324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.158623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 950/1873] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:20.170555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64446b8-4a39-46fb-ad4a-10967d22fc5b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.174673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.176100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.176222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.176852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.177163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.177448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.178094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.180469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.221284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 924/1874] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:20 2022] POST /identity/v3/projects => generated 365 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:20.223429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.254364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21cb53-ac68-42fb-b7df-699416c65779 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.326416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a704-7749-4353-9dfe-b2682c6b45cb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.333565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.334992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.335389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.335787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.336787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.339953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.349405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.350064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.350346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.350764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.364831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.366352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.371902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 925/1875] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:20 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:20.374301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.378660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 951/1876] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:20.386328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65218f-154f-451a-939b-c356d9f05f09 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.391385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.392078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.392545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.392698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.393680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.395517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.406919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 926/1877] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:20.411387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.442508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0360f-e3ce-4ca6-9227-bfb3ff18944a service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.449195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.449933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.450479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.450479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] PATH_INFO: `/v3/projects/6af77e8783334f99bccb02908f609bb5/users/47d8a2b39269418c8b9cfbda430d01fe/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.469994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af77e8783334f99bccb02908f609bb5, user_id=47d8a2b39269418c8b9cfbda430d01fe, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.472621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.493656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 952/1878] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:20 2022] PUT /identity/v3/projects/6af77e8783334f99bccb02908f609bb5/users/47d8a2b39269418c8b9cfbda430d01fe/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:20.497528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.509010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6956-003a-4dba-a00e-8bf48d1527ac admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.585370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da9214-50da-4db5-8676-c88ce990d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.586061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9214-50da-4db5-8676-c88ce990d2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.592596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9214-50da-4db5-8676-c88ce990d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.593208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da9214-50da-4db5-8676-c88ce990d2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.593604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9214-50da-4db5-8676-c88ce990d2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.595241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da9214-50da-4db5-8676-c88ce990d2c9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.607394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 927/1879] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:20.611362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.617315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:20.631467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d435a-6305-4557-8fa2-b3727caf95b2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.637576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.638856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.639269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.639560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] PATH_INFO: `/v3/projects/6af77e8783334f99bccb02908f609bb5/users/47d8a2b39269418c8b9cfbda430d01fe/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.641926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af77e8783334f99bccb02908f609bb5, user_id=47d8a2b39269418c8b9cfbda430d01fe, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.644648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.656468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 953/1880] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:20 2022] PUT /identity/v3/projects/6af77e8783334f99bccb02908f609bb5/users/47d8a2b39269418c8b9cfbda430d01fe/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:20.667856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.668147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.668411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.690910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:20.706559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.709048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.731750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] MFA Rules not processed for user `47d8a2b39269418c8b9cfbda430d01fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:20.733492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.843330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 928/1881] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:20.855012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:20.856818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:20.867629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db8cc4-59b1-4b74-83ea-c3b975370dd3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.884654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.885347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.885635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.885916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] PATH_INFO: `/v3/projects/fd5a7317cc214722a08759e760a05a2f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.887485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5a7317cc214722a08759e760a05a2f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.889439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.924925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f317-c7f3-4c92-ba8a-b36cc243dcbe None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:20.931093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:20.931755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:20.932059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:20.932796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:20.960030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:20.962832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:20.977784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 929/1882] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:20.999301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5a7317cc214722a08759e760a05a2f', 'request_id': 'req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.011759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5a7317cc214722a08759e760a05a2f', 'request_id': 'req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.024736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5a7317cc214722a08759e760a05a2f', 'request_id': 'req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.044042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] The token cache is being invalidate because project fd5a7317cc214722a08759e760a05a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:21.044389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.046670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.051115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 954/1883] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:20 2022] DELETE /identity/v3/projects/fd5a7317cc214722a08759e760a05a2f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:21.055914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:21.078004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e6b43-d3f5-4c7f-b113-1b2d2d6ac4cd service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:21.100738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:21.102728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:21.235753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:21.236659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:21.237094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:21.237715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29224a70-1fe3-4e2d-8dfc-42a2a11cda9b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:21.238173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] PATH_INFO: `/v3/users/00cf0a1629c84fd0bf82df386ff1bd47` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:21.241489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:21.242227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:21.242568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cf0a1629c84fd0bf82df386ff1bd47)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:21.242697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:21.242928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:21.244891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:21.246250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:21.322956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:21.369482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:21.394150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cf0a1629c84fd0bf82df386ff1bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.395787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cf0a1629c84fd0bf82df386ff1bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.408929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:21.410680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:21.415856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cf0a1629c84fd0bf82df386ff1bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.446253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 955/1884] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:21.471803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cf0a1629c84fd0bf82df386ff1bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.474837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c34257b-8b2a-4dbb-b689-ae22105eec3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cf0a1629c84fd0bf82df386ff1bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:21.502234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 930/1885] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:21 2022] DELETE /identity/v3/users/00cf0a1629c84fd0bf82df386ff1bd47 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:21.896432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:21.897960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:21.912565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ee353-eafa-4121-b1e6-153c33cc1c2c service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:21.976098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:21.976964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:21.977287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:21.977564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] PATH_INFO: `/v3/projects/bb100970fc0b4c6197610d0d6942c525` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:21.978745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb100970fc0b4c6197610d0d6942c525)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:21.980583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.028683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb100970fc0b4c6197610d0d6942c525', 'request_id': 'req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:22.034095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb100970fc0b4c6197610d0d6942c525', 'request_id': 'req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:22.042527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb100970fc0b4c6197610d0d6942c525', 'request_id': 'req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:22.054295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] The token cache is being invalidate because project bb100970fc0b4c6197610d0d6942c525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:22.054724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:22.055428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-07ba1711-2c77-4736-bc5e-cccd2d3e4b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:22.056943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 956/1886] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:21 2022] DELETE /identity/v3/projects/bb100970fc0b4c6197610d0d6942c525 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:22.062094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.062589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.062689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.084982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:22.086410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:22.147854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 931/1887] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:22.156908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.157427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.157782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.178310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:22.180192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:22.188972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 957/1888] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:22.193238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.203108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec85a-ab28-4297-93ff-82ffe0247939 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.207873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.208490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.208799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.209074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.209832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:22.210050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.212227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.224376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 932/1889] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:22.229436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.238586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3598c0-df59-4a69-868c-902ac932dbd1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.243796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.244566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.244852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.245164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.245824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.247856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.285922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 958/1890] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:22.290755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.305576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f085a4e-d45a-41de-a09f-abc8659ed600 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.411505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.412148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.412433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.412707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.413475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.415820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.446311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 933/1891] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:22.462594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.477027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd002b-b9ea-46b5-92b9-41d4813807d8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.482871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.484796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.485185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.485663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.487582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.490212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.503695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 959/1892] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:22.508679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.521078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6aad8-d21a-4661-b71b-9876205ea980 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.527329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83320e7-c8e9-442f-9a98-2926906aa327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.528138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83320e7-c8e9-442f-9a98-2926906aa327 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.528559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83320e7-c8e9-442f-9a98-2926906aa327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.529286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83320e7-c8e9-442f-9a98-2926906aa327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.529850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83320e7-c8e9-442f-9a98-2926906aa327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.531460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83320e7-c8e9-442f-9a98-2926906aa327 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.557719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 934/1893] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:22.558532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.571806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae83056-852f-43f0-889c-ee3d6345cbb1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.577349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.578376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.578947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.579234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] PATH_INFO: `/v3/projects/2a6f8fa4167c44d4afd72f266a2bb306/users/5463503d7e4f4858952626aa6d454b07/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.615872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6f8fa4167c44d4afd72f266a2bb306, user_id=5463503d7e4f4858952626aa6d454b07, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.626804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.640296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:22.647286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 960/1894] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:22 2022] PUT /identity/v3/projects/2a6f8fa4167c44d4afd72f266a2bb306/users/5463503d7e4f4858952626aa6d454b07/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:22.659081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.659616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.659979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.707654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] MFA Rules not processed for user `5463503d7e4f4858952626aa6d454b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:22.709198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:22.724606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:22.824116 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 935/1895] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:22.827468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.900766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85440df1-e127-4fc9-a935-cfe593c2df8e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:22.904806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:22.905485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:22.905767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:22.906049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:22.906914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:22.909170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:22.954429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 961/1896] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:22.959018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:22.987558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439295b-9c2c-46ce-bee8-27ca18fd0a0c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:23.156557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:23.158643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.158856 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.160438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.161469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:23.167759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:23.237003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 936/1897] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:22 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:23.240092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:23.266655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd2c5e-2755-40c8-a39f-663ca4c865e9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:23.280439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:23.282091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.282689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.283138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.283937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:23.286127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:23.307410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 962/1898] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:23.317093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:23.354268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586726-d25f-43af-85f4-dd8413615b58 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:23.373467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:23.374215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.375426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.376601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] PATH_INFO: `/v3/projects/d5935d875b594db5b33ba08308ee96a7/users/175499788ba54883bfc7165407709fbe/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.427451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5935d875b594db5b33ba08308ee96a7, user_id=175499788ba54883bfc7165407709fbe, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:23.433838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:23.466644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 937/1899] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:23 2022] PUT /identity/v3/projects/d5935d875b594db5b33ba08308ee96a7/users/175499788ba54883bfc7165407709fbe/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:23.470679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:23.488757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9547716-79b2-448e-aaa6-dbfe1188f073 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:23.572225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca63f2-a443-4072-be97-05ef089145bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:23.573152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca63f2-a443-4072-be97-05ef089145bf admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.573152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca63f2-a443-4072-be97-05ef089145bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.573469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca63f2-a443-4072-be97-05ef089145bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.574116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca63f2-a443-4072-be97-05ef089145bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:23.575720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca63f2-a443-4072-be97-05ef089145bf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:23.592632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 963/1900] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:23.600303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:23.611320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66b742-080d-4290-889f-4122a2c67190 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:23.617966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:23.619130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.619424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.619702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] PATH_INFO: `/v3/projects/d5935d875b594db5b33ba08308ee96a7/users/175499788ba54883bfc7165407709fbe/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.621906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5935d875b594db5b33ba08308ee96a7, user_id=175499788ba54883bfc7165407709fbe, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:23.624810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:23.639958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 938/1901] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:23 2022] PUT /identity/v3/projects/d5935d875b594db5b33ba08308ee96a7/users/175499788ba54883bfc7165407709fbe/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:23.650722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.651170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.651463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.705601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] MFA Rules not processed for user `175499788ba54883bfc7165407709fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:23.707725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:23.808488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:23.826214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 964/1902] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:23.837132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:23.839563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:23.921679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9c13f-2851-43e0-9433-36c61859689c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:23.925393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226408-d754-46ee-abe8-b6ce26d122f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:23.926008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226408-d754-46ee-abe8-b6ce26d122f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:23.926282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226408-d754-46ee-abe8-b6ce26d122f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:23.926548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226408-d754-46ee-abe8-b6ce26d122f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:23.936411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d226408-d754-46ee-abe8-b6ce26d122f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:23.938112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d226408-d754-46ee-abe8-b6ce26d122f8 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:23.949414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 939/1903] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:24.018673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.085122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0b52-1f57-4329-9ea3-9f83fb709ee7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:24.089919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:24.090625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.090909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.091181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] PATH_INFO: `/v3/users/5463503d7e4f4858952626aa6d454b07` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.092312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5463503d7e4f4858952626aa6d454b07)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:24.094286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:24.142469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5463503d7e4f4858952626aa6d454b07'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.143124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5463503d7e4f4858952626aa6d454b07'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.150638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5463503d7e4f4858952626aa6d454b07'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.157972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5463503d7e4f4858952626aa6d454b07'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.158638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5463503d7e4f4858952626aa6d454b07'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.177098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 965/1904] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:24 2022] DELETE /identity/v3/users/5463503d7e4f4858952626aa6d454b07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:24.181782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.182279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.182369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.190711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:24.202317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:24.203546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:24.264509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 940/1905] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:24.275735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.277284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:24.335430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907b92e-409f-4d57-8afd-7a4fd152f9e0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:24.339153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14035d40-3fba-44c7-b6ed-3ffe8eba768a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:24.339761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035d40-3fba-44c7-b6ed-3ffe8eba768a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.340036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035d40-3fba-44c7-b6ed-3ffe8eba768a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.340307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14035d40-3fba-44c7-b6ed-3ffe8eba768a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.350282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035d40-3fba-44c7-b6ed-3ffe8eba768a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:24.352321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14035d40-3fba-44c7-b6ed-3ffe8eba768a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:24.362219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 966/1906] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:24.477035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.479316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:24.492490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd44e4-b20d-4ecd-8484-05f98c2683f2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:24.497500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:24.498144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.498419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.498689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] PATH_INFO: `/v3/users/3df2ff0884de4d26a8a79a114fb3e7c5` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.499807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df2ff0884de4d26a8a79a114fb3e7c5)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:24.501795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:24.570071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df2ff0884de4d26a8a79a114fb3e7c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.571039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df2ff0884de4d26a8a79a114fb3e7c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.580447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df2ff0884de4d26a8a79a114fb3e7c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.600624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df2ff0884de4d26a8a79a114fb3e7c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.601627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df2ff0884de4d26a8a79a114fb3e7c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.616336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 941/1907] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:24 2022] DELETE /identity/v3/users/3df2ff0884de4d26a8a79a114fb3e7c5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:24.621976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.623251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.623734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.649055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:24.650306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:24.665183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:24.681424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.682613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:24.730174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 967/1908] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:24.746799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.748424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:24.793078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19601645-0d36-43ad-bfe5-f2271d198909 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:24.798185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:24.798837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.799121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.799399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] PATH_INFO: `/v3/projects/2a6f8fa4167c44d4afd72f266a2bb306` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.800536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6f8fa4167c44d4afd72f266a2bb306)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:24.802522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:24.833917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:24.846920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf9703-5f47-41d6-a849-cf9c018b2284 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:24.852844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:24.853350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:24.853701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:24.854190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:24.866549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:24.868474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:24.879756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 968/1909] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:24.895654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6f8fa4167c44d4afd72f266a2bb306', 'request_id': 'req-2c8d3c29-3783-48da-8e52-f0b2464092ae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.906520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6f8fa4167c44d4afd72f266a2bb306', 'request_id': 'req-2c8d3c29-3783-48da-8e52-f0b2464092ae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.916413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6f8fa4167c44d4afd72f266a2bb306', 'request_id': 'req-2c8d3c29-3783-48da-8e52-f0b2464092ae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.933275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] The token cache is being invalidate because project 2a6f8fa4167c44d4afd72f266a2bb306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:24.933275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.933275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:24.936769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 942/1910] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:24 2022] DELETE /identity/v3/projects/2a6f8fa4167c44d4afd72f266a2bb306 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:24.939023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.958084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8553cc7-4322-4b03-ab07-a69f8bba327e service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:24.968235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:24.970967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.043918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.046840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.047131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.047413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] PATH_INFO: `/v3/users/175499788ba54883bfc7165407709fbe` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.049819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=175499788ba54883bfc7165407709fbe)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.053493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.109558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3c29-3783-48da-8e52-f0b2464092ae admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.129661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.130350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.130633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.130909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] PATH_INFO: `/v3/users/cce3656f8be547f1b0c2fcd003f6d7c1` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.137098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce3656f8be547f1b0c2fcd003f6d7c1)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.141091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.152635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175499788ba54883bfc7165407709fbe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.153407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175499788ba54883bfc7165407709fbe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.165019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175499788ba54883bfc7165407709fbe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.175798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175499788ba54883bfc7165407709fbe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.177242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-389f6c13-abd1-4bee-8c88-395a703bd8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175499788ba54883bfc7165407709fbe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.179010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:25.202478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 969/1911] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:24 2022] DELETE /identity/v3/users/175499788ba54883bfc7165407709fbe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:25.208674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce3656f8be547f1b0c2fcd003f6d7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.209715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce3656f8be547f1b0c2fcd003f6d7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.219587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce3656f8be547f1b0c2fcd003f6d7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.236810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce3656f8be547f1b0c2fcd003f6d7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.237649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce3656f8be547f1b0c2fcd003f6d7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.260742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 943/1912] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:24 2022] DELETE /identity/v3/users/cce3656f8be547f1b0c2fcd003f6d7c1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:25.265474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.265749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.266093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.290494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:25.292019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.330017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:25.331563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.408539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 970/1913] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:25.421728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:25.423040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.424044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:25.467887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417fa76-dcb2-4236-ac7e-8d9f7fe82463 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.474634 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.475261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.475542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.475814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] PATH_INFO: `/v3/projects/c5b7e4bb8e644ec6a5b585e28c10c969` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.477022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b7e4bb8e644ec6a5b585e28c10c969)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.478975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.488844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f49395-bbf1-419e-87fb-5de8dbc752f6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.496846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.497597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.497944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.498282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.508323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.510307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.524919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 971/1914] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:25.532768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:25.535359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.537762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b7e4bb8e644ec6a5b585e28c10c969', 'request_id': 'req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.547507 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b7e4bb8e644ec6a5b585e28c10c969', 'request_id': 'req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.553902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac60884-8533-4946-a8e4-59559190b357 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.555645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b7e4bb8e644ec6a5b585e28c10c969', 'request_id': 'req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.569250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] The token cache is being invalidate because project c5b7e4bb8e644ec6a5b585e28c10c969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:25.569622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.570523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.576123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 944/1915] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:25 2022] DELETE /identity/v3/projects/c5b7e4bb8e644ec6a5b585e28c10c969 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:25.577042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:25.578476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.660987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.661911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.662928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.663213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] PATH_INFO: `/v3/projects/d5935d875b594db5b33ba08308ee96a7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.663672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d67d8-9ce1-4f9a-a7eb-bf842176f059 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.667500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5935d875b594db5b33ba08308ee96a7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.670268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.672198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.673163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.673364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.673649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] PATH_INFO: `/v3/users/966f37828c1f4abc8358bf8da7781ccb` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.674914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966f37828c1f4abc8358bf8da7781ccb)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.677329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.708093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:25.731004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5935d875b594db5b33ba08308ee96a7', 'request_id': 'req-a55f2022-4cbf-44e0-9861-b63a0ccb1637'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.736770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5935d875b594db5b33ba08308ee96a7', 'request_id': 'req-a55f2022-4cbf-44e0-9861-b63a0ccb1637'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.737900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966f37828c1f4abc8358bf8da7781ccb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.739145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966f37828c1f4abc8358bf8da7781ccb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.747235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5935d875b594db5b33ba08308ee96a7', 'request_id': 'req-a55f2022-4cbf-44e0-9861-b63a0ccb1637'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.750051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966f37828c1f4abc8358bf8da7781ccb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.759729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:25.764548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] The token cache is being invalidate because project d5935d875b594db5b33ba08308ee96a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:25.764548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.765121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a55f2022-4cbf-44e0-9861-b63a0ccb1637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.770164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 972/1916] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:25 2022] DELETE /identity/v3/projects/d5935d875b594db5b33ba08308ee96a7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:25.772430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.773227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.773520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.774362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966f37828c1f4abc8358bf8da7781ccb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.775148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7b196f60-6e9a-42db-a8a7-09de17508ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966f37828c1f4abc8358bf8da7781ccb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:25.806222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:25.807921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.809424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 945/1917] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:25 2022] DELETE /identity/v3/users/966f37828c1f4abc8358bf8da7781ccb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:25.886504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 973/1918] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:25.902130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.902739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.902864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.930732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:25.932285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.935431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:25.937303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:25.946508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 946/1919] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:25.951047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:25.965088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db22371-35ce-4d91-8b6a-d8f70a0e966d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.970946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.971334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635f941-9062-4e25-9945-8a4ae01791ba None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:25.971655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.971865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.972142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] PATH_INFO: `/v3/projects/140da53af2334e5a8d9de6c1538b3239` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.973313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140da53af2334e5a8d9de6c1538b3239)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.975263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.978915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:25.979535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:25.979815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:25.980089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:25.980738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:25.981048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:25.982679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:25.998892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 947/1920] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:23:26.003300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.014774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b55704-9a84-4911-bf10-9f074b7bd03d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.019835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.020479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.020764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.021045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.021820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.024223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.040471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140da53af2334e5a8d9de6c1538b3239', 'request_id': 'req-999d58b5-89a6-43e0-a3ab-cde6497f03b2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.050030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140da53af2334e5a8d9de6c1538b3239', 'request_id': 'req-999d58b5-89a6-43e0-a3ab-cde6497f03b2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.058894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140da53af2334e5a8d9de6c1538b3239', 'request_id': 'req-999d58b5-89a6-43e0-a3ab-cde6497f03b2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.063442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 948/1921] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:26 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:26.063954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.074034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] The token cache is being invalidate because project 140da53af2334e5a8d9de6c1538b3239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:26.074355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.075037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.076855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 974/1922] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:25 2022] DELETE /identity/v3/projects/140da53af2334e5a8d9de6c1538b3239 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:26.080991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.087848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.149718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84533a45-57c2-4b72-beac-8a8d318be092 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.151613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:26.157586 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.158453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.158921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.159560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.161084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.165162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.185239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d58b5-89a6-43e0-a3ab-cde6497f03b2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.193393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.194297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 949/1923] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:26 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:26.194962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.195546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.196006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] PATH_INFO: `/v3/users/47d8a2b39269418c8b9cfbda430d01fe` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.197588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d8a2b39269418c8b9cfbda430d01fe)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.198343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.200070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.200654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.215694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a6e52-121a-41d5-976b-dc96f861735f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.222337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.223074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.223423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.223706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.224365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.226186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.243517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 950/1924] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:26.250822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.264479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb330d-ea85-409a-be13-ec8a684c2008 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.270825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.271544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.271826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.272123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.272882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.275706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.282487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d8a2b39269418c8b9cfbda430d01fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.282487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d8a2b39269418c8b9cfbda430d01fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.292513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d8a2b39269418c8b9cfbda430d01fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.295239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 951/1925] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:26.296629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.299816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.306718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d8a2b39269418c8b9cfbda430d01fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.307523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d8a2b39269418c8b9cfbda430d01fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.326654 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb2a2b-6916-4d5c-a871-299ff06d2ed7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.333152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 975/1926] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:26 2022] DELETE /identity/v3/users/47d8a2b39269418c8b9cfbda430d01fe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:26.333152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.333152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.338062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.338973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.339959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.340315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] PATH_INFO: `/v3/projects/b532c05f3ca945c3a710a85fed057ce9` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.341876 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b532c05f3ca945c3a710a85fed057ce9)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.344086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.408637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b532c05f3ca945c3a710a85fed057ce9', 'request_id': 'req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.420421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b532c05f3ca945c3a710a85fed057ce9', 'request_id': 'req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.422857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:26.432147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b532c05f3ca945c3a710a85fed057ce9', 'request_id': 'req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.435750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d332c-035c-4541-91f9-d620e2454a23 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.445867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] The token cache is being invalidate because project b532c05f3ca945c3a710a85fed057ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:26.445867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.446230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.448276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 952/1927] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:26 2022] DELETE /identity/v3/projects/b532c05f3ca945c3a710a85fed057ce9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:26.452232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.453656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.508141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0a3c9-6805-4cc8-8a76-5414aa2b8879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.513899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a3c9-6805-4cc8-8a76-5414aa2b8879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.514573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a3c9-6805-4cc8-8a76-5414aa2b8879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.515047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a3c9-6805-4cc8-8a76-5414aa2b8879 admin admin] PATH_INFO: `/v3/projects/1e33df386d8648b68d4a347a2d8c5636/users/227e457382a04d19bc3c967e1d3d2a33/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.528474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:26.544629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0cd37-b918-4a3b-8c9b-44e1556ef024 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.546280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0a3c9-6805-4cc8-8a76-5414aa2b8879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e33df386d8648b68d4a347a2d8c5636, user_id=227e457382a04d19bc3c967e1d3d2a33, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.550215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0a3c9-6805-4cc8-8a76-5414aa2b8879 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.561736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.562405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.562685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.562976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] PATH_INFO: `/v3/users/e559165f26894d76962de222ed26f8ce` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.568118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e559165f26894d76962de222ed26f8ce)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.569187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 976/1928] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:26 2022] PUT /identity/v3/projects/1e33df386d8648b68d4a347a2d8c5636/users/227e457382a04d19bc3c967e1d3d2a33/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:26.570707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.574969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.575616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.576604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.644805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:26.646174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.646921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e559165f26894d76962de222ed26f8ce'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.647600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e559165f26894d76962de222ed26f8ce'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.667185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e559165f26894d76962de222ed26f8ce'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.686796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e559165f26894d76962de222ed26f8ce'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.688145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e559165f26894d76962de222ed26f8ce'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.708786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 953/1929] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:26 2022] DELETE /identity/v3/users/e559165f26894d76962de222ed26f8ce => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:26.735099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 977/1930] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:26.745721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.747164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.780295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:26.781752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:26.806456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102514b6-f93d-4f60-a0d4-dd001dd3b794 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.823473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa52eee-4289-4c4b-9647-b6d4d41e295e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:26.828089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419c4cf-fd9d-4322-bb38-42e0b96e9b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.828734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c4cf-fd9d-4322-bb38-42e0b96e9b74 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.829012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c4cf-fd9d-4322-bb38-42e0b96e9b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.829315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c4cf-fd9d-4322-bb38-42e0b96e9b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.854104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:26.889129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:26.889743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:26.890315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:26.890315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] PATH_INFO: `/v3/projects/6af77e8783334f99bccb02908f609bb5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:26.891407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af77e8783334f99bccb02908f609bb5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.893383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.916155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419c4cf-fd9d-4322-bb38-42e0b96e9b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:26.916155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419c4cf-fd9d-4322-bb38-42e0b96e9b74 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:26.928453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 954/1931] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:26.966252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af77e8783334f99bccb02908f609bb5', 'request_id': 'req-a1015403-5f4d-43ba-a137-95455f359b12'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.973727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af77e8783334f99bccb02908f609bb5', 'request_id': 'req-a1015403-5f4d-43ba-a137-95455f359b12'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.983967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af77e8783334f99bccb02908f609bb5', 'request_id': 'req-a1015403-5f4d-43ba-a137-95455f359b12'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.996811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] The token cache is being invalidate because project 6af77e8783334f99bccb02908f609bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:26.997222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.997881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a1015403-5f4d-43ba-a137-95455f359b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:26.999446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 978/1932] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:26 2022] DELETE /identity/v3/projects/6af77e8783334f99bccb02908f609bb5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:27.004297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.004584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.004859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.026431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:27.027824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.091874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 955/1933] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:27.099664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.099960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.100242 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.123340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:27.124671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.132673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 979/1934] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:27.138924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.150669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96189a7c-5108-45ba-b578-3e8eced223dd None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.155936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.156646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.156991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.157449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.158177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:27.158548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.160678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.178113 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 956/1935] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:27.179296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.189663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741e196-c792-4002-969d-b8a5f23ede5d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.195527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.196287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.196679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.196966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.197652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.199581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.211454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:27.242054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.245741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.265605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 980/1936] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:27.269454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.271663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fa61a-0222-4d1d-9cb4-baa0159e5939 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.354833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.355577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.355793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.356072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] PATH_INFO: `/v3/projects/f5f7e3cc370f45ad8430f6a096644c91` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.357292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f7e3cc370f45ad8430f6a096644c91)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.359286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.367689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfede0f7-a366-4889-9f76-0995bb29f7c6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.373579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.374197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.374477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.374778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.376619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.378758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.409043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 981/1937] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:27.410158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.423213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd868fc-62db-4a91-bdca-40ed5972d6c2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.425920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:27.431381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f7e3cc370f45ad8430f6a096644c91', 'request_id': 'req-5162f21f-b297-4c71-8059-40edc39592bc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:27.441471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f7e3cc370f45ad8430f6a096644c91', 'request_id': 'req-5162f21f-b297-4c71-8059-40edc39592bc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:27.452421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f7e3cc370f45ad8430f6a096644c91', 'request_id': 'req-5162f21f-b297-4c71-8059-40edc39592bc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:27.466115 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] The token cache is being invalidate because project f5f7e3cc370f45ad8430f6a096644c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:27.466491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:27.467444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5162f21f-b297-4c71-8059-40edc39592bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:27.469467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 957/1938] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:27 2022] DELETE /identity/v3/projects/f5f7e3cc370f45ad8430f6a096644c91 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:27.474174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859906-2abf-44e2-8bb2-02b6a51f485d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.474970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859906-2abf-44e2-8bb2-02b6a51f485d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.476566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859906-2abf-44e2-8bb2-02b6a51f485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.513789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.514608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.514897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.515177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.516048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.517088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b9859906-2abf-44e2-8bb2-02b6a51f485d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:27.517840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.518602 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b9859906-2abf-44e2-8bb2-02b6a51f485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.531755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 982/1939] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:27.531940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 958/1940] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:27.540541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.541097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.541430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.541825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.542389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.557544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d5576-cd28-4181-a9af-5002390c18d6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.575794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.577139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.577513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.577891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.578715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.578993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:27.584831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.593420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.600282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 983/1941] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:27.604273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.619340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 959/1942] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:27.620284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.631846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a382724-f778-4c61-9e0c-4e59c58c2f08 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.647256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4c28-375e-4b14-8551-b7ac8f91d06a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.654294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0263cb-1b51-4f17-bb1f-c4450b5205a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.655169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0263cb-1b51-4f17-bb1f-c4450b5205a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.655278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0263cb-1b51-4f17-bb1f-c4450b5205a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.655499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0263cb-1b51-4f17-bb1f-c4450b5205a0 admin admin] PATH_INFO: `/v3/projects/6bc29e917d1c48ec83301cee571a5bb7/users/94a5c6af0a2f4dddb4572678e54f3b5e/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.665382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.666016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.666298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.666571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.667231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:27.667536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.672587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.676955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0263cb-1b51-4f17-bb1f-c4450b5205a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc29e917d1c48ec83301cee571a5bb7, user_id=94a5c6af0a2f4dddb4572678e54f3b5e, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.682609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0263cb-1b51-4f17-bb1f-c4450b5205a0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.693715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 960/1943] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:27.698203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.708544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f559fe-ae28-451c-bbf7-2d96749db67b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:27.708835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 984/1944] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:27 2022] PUT /identity/v3/projects/6bc29e917d1c48ec83301cee571a5bb7/users/94a5c6af0a2f4dddb4572678e54f3b5e/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:27.723129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.724946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.725390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.821894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] MFA Rules not processed for user `94a5c6af0a2f4dddb4572678e54f3b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:27.824336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:27.869396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:27.908579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:27.909794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:27.910228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:27.910648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:27.911430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:27.914277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:27.949164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 985/1945] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:27.955193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.968795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 961/1946] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:27.970860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:27.981551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623096c-3730-4769-95e3-54793a2b0386 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.059764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.060765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.061229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.061784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.077346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.077346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.082022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631ad5e-56f2-490d-be28-9d300022f11a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.089552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.090197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.090411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.090807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.091678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.093768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.107055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 986/1947] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:28.110815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.121601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 962/1948] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:27 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:28.126192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.140401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578143d5-3db0-47a1-9e7e-89bb43bce712 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.168489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:28.193699 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bbb3c-852e-4a40-923f-df04f4570e4e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.198961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.199590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.199851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.200132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.200777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.216528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.247260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 987/1949] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:28 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:28.250773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.263719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c927e4b-ec81-4b0c-b398-523ffbea3ae5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.270376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.271420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.271420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.271638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.272567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.274587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.278957 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.279589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.279873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.280148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.280808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.283279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.291271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 988/1950] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:28.296511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.311943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50eeed9-6e8b-449b-8588-238179134725 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.326658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 963/1951] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:28.327547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.328248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.328534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.328813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] PATH_INFO: `/v3/projects/948a3f19a8fc422eb9c346a8737b4238/users/7d617c3eed97412b8dabbb7fa64235cc/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.334454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.352293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38c3f1-1feb-4c72-aaa7-5997451f17b7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.365615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948a3f19a8fc422eb9c346a8737b4238, user_id=7d617c3eed97412b8dabbb7fa64235cc, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.368922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.369590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.369872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.370167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.370794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.374535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.378083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.398164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 964/1952] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:28.402709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 989/1953] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:28 2022] PUT /identity/v3/projects/948a3f19a8fc422eb9c346a8737b4238/users/7d617c3eed97412b8dabbb7fa64235cc/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:28.403465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.406755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.428307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4287f22-34cd-4d4d-bcf1-302876fcd740 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.431101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:28.609138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f97c79-e196-4b74-a1e8-f477e3912361 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.628859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f27e8-3399-401d-86ba-1414e5303771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.629986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f27e8-3399-401d-86ba-1414e5303771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.630274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f27e8-3399-401d-86ba-1414e5303771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.630554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f27e8-3399-401d-86ba-1414e5303771 admin admin] PATH_INFO: `/v3/projects/5731dbeb1c934b67951afffb0523cb58/users/4c4264c66b2c4628a7258f4424b6cab4/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.632143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.633333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.633611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.633924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.634634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.636681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.667394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f27e8-3399-401d-86ba-1414e5303771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5731dbeb1c934b67951afffb0523cb58, user_id=4c4264c66b2c4628a7258f4424b6cab4, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.670159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f27e8-3399-401d-86ba-1414e5303771 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.670642 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 990/1954] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:28.671705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.698170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6e664-7bd1-4b44-b912-41623d1b6a64 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:28.702865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 965/1955] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:28 2022] PUT /identity/v3/projects/5731dbeb1c934b67951afffb0523cb58/users/4c4264c66b2c4628a7258f4424b6cab4/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:28.722925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1e2dd-3cf5-4a91-9d9a-f98f6fca24e6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.722925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1e2dd-3cf5-4a91-9d9a-f98f6fca24e6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.722925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1e2dd-3cf5-4a91-9d9a-f98f6fca24e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.763296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-54f1e2dd-3cf5-4a91-9d9a-f98f6fca24e6 None None] MFA Rules not processed for user `4c4264c66b2c4628a7258f4424b6cab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:28.765314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-54f1e2dd-3cf5-4a91-9d9a-f98f6fca24e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:28.821943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ee61b-3f0f-4a3f-a9fc-09be4660ce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:28.822945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee61b-3f0f-4a3f-a9fc-09be4660ce46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.823234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee61b-3f0f-4a3f-a9fc-09be4660ce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.823515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ee61b-3f0f-4a3f-a9fc-09be4660ce46 admin admin] PATH_INFO: `/v3/projects/948a3f19a8fc422eb9c346a8737b4238/users/7d617c3eed97412b8dabbb7fa64235cc/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.826233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ee61b-3f0f-4a3f-a9fc-09be4660ce46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948a3f19a8fc422eb9c346a8737b4238, user_id=7d617c3eed97412b8dabbb7fa64235cc, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:28.829098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ee61b-3f0f-4a3f-a9fc-09be4660ce46 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:28.841253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 991/1956] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:28 2022] PUT /identity/v3/projects/948a3f19a8fc422eb9c346a8737b4238/users/7d617c3eed97412b8dabbb7fa64235cc/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:28.842292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.842579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.842856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.849806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 966/1957] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:28.852501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:28.852793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:28.853063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:28.878192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] MFA Rules not processed for user `227e457382a04d19bc3c967e1d3d2a33`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:28.879516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:28.887576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] MFA Rules not processed for user `7d617c3eed97412b8dabbb7fa64235cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:28.888782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:28.894476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:28.962025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 992/1958] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:28.964102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.993171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 967/1959] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:28.993171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:28.993171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:29.015450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:29.055829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ca7e4-126d-4d3b-8484-dca5facb49eb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.061499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.062133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.062415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.062690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.063338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.065315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.079626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e874518-9167-4e25-8b35-28f8008e5043 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.087631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.088811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.089162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.089508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.090843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.093128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.097269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 993/1960] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:28 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:29.098166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.100378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:29.125410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 968/1961] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:28 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:29.126464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.170693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ec32e-b5da-440b-8b03-933575aefabe admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.209070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8aa010-5e5a-499b-b387-2db1be552461 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.214751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.215295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.215570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.215843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.216482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.218470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.227458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.228158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.228433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.228709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.247421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 969/1962] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:29 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:29.247421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.266236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1fd31-dab5-4041-a35b-d3dcb7120beb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.273715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.275218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.275746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.276026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.276699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.278692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.299267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:29.308776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 970/1963] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:29 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:29.308776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.319118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db65ed7-8ec6-4e9e-9911-9f1616730b11 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.319863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.321816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.324203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.324831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.325135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.325426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.326077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.328170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.335735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 994/1964] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:29.339133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.341537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 971/1965] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:29.345773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.354876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47676657-dec9-4dad-b015-4e55641e387e service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.358893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43958e-1913-402d-b015-0f3635b29887 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.359971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.360742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.361024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.361338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.361994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.363608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.365103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.365882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.366165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.366435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.367175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.369299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.378513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 995/1966] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:29.384098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.386273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 972/1967] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:29.390256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.403187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9fb43-5f4e-4a66-a94f-b54a97fc9f41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.408906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54d9cf-a27a-47ee-8e39-1d279566f08b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.410183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.410980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.411320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.411834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] PATH_INFO: `/v3/projects/6147d122e5514ff9906ed6a8d5921131/users/72cbe87975be4c72ad2208409b1ddf5c/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.416786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:29.420666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.421672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.421933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.422395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] PATH_INFO: `/v3/projects/9ec138d881194d21af81b1c9cc72a0b7/users/55138fc779f745ac811a67bc9dbd69b2/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.438102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6147d122e5514ff9906ed6a8d5921131, user_id=72cbe87975be4c72ad2208409b1ddf5c, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.439682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec138d881194d21af81b1c9cc72a0b7, user_id=55138fc779f745ac811a67bc9dbd69b2, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.440966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.442341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.457475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 996/1968] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:29 2022] PUT /identity/v3/projects/6147d122e5514ff9906ed6a8d5921131/users/72cbe87975be4c72ad2208409b1ddf5c/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:29.458182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.459953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:29.470248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 973/1969] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:29 2022] PUT /identity/v3/projects/9ec138d881194d21af81b1c9cc72a0b7/users/55138fc779f745ac811a67bc9dbd69b2/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:29.470248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.532441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf4b7a-601e-4277-9acf-fbbbf34dcda4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.546261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c6e8-b8c3-4ebf-b21d-8400adf64ba6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.572031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6832e2-ec40-4f42-b4e6-b99e51985888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.572669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6832e2-ec40-4f42-b4e6-b99e51985888 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.572953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6832e2-ec40-4f42-b4e6-b99e51985888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.573254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6832e2-ec40-4f42-b4e6-b99e51985888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.573913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6832e2-ec40-4f42-b4e6-b99e51985888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.575536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6832e2-ec40-4f42-b4e6-b99e51985888 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.593434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.594057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.594342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.594615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.603261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 974/1970] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:29.603261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.603516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.603596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.642382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] MFA Rules not processed for user `55138fc779f745ac811a67bc9dbd69b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:29.644054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:29.690786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.692360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.704060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 997/1971] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:29.705057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.717944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c62945-9592-4921-97d7-217f89dab6a3 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.724331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.725899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.725899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.725899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] PATH_INFO: `/v3/projects/6147d122e5514ff9906ed6a8d5921131/users/72cbe87975be4c72ad2208409b1ddf5c/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.728136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6147d122e5514ff9906ed6a8d5921131, user_id=72cbe87975be4c72ad2208409b1ddf5c, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.730984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.753801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 998/1972] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:29 2022] PUT /identity/v3/projects/6147d122e5514ff9906ed6a8d5921131/users/72cbe87975be4c72ad2208409b1ddf5c/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:29.781266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 975/1973] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:29.786617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.856573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:29.882153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb5399-9a5e-4f4f-b239-74517636c507 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:29.888560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:29.889269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:29.889600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:29.891248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:29.892125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:29.894341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:29.937050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 999/1974] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:29 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:29.941418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:29.955067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59417ef-61ed-4a75-abf7-2d668d1b7818 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:30.019035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:30.070781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:30.071419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.071696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.071980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:30.072626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:30.074614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:30.125514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 976/1975] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:29 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:30.128530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:30.144777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b80f-1391-4ca7-bf4f-bfcd8c079166 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:30.150871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:30.152002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.152771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.153298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:30.154442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:30.156585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:30.171915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1000/1976] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:30.176301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:30.192091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14c6f8-1b56-4b89-8c69-7abcefae049b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:30.198890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:30.199743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.200565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.200565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] PATH_INFO: `/v3/projects/7d73995f18a74bcc98a7d8fa5150db13/users/481b0fddd06444329d618bd0542a01ad/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:30.222613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d73995f18a74bcc98a7d8fa5150db13, user_id=481b0fddd06444329d618bd0542a01ad, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:30.225529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:30.276272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 977/1977] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:30 2022] PUT /identity/v3/projects/7d73995f18a74bcc98a7d8fa5150db13/users/481b0fddd06444329d618bd0542a01ad/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:30.277311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:30.303718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516bc6-110f-4343-9348-8a597eb108d4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:30.453961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f70c-a3aa-4138-8332-6b75052c5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:30.454605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f70c-a3aa-4138-8332-6b75052c5032 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.454884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f70c-a3aa-4138-8332-6b75052c5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.455157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f70c-a3aa-4138-8332-6b75052c5032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:30.455823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39f70c-a3aa-4138-8332-6b75052c5032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:30.457443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39f70c-a3aa-4138-8332-6b75052c5032 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:30.489964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1001/1978] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:30.491546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:30.504449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8d273-6657-41e4-af1f-89e651dba528 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:30.513914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:30.514408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.514689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.514966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] PATH_INFO: `/v3/projects/7d73995f18a74bcc98a7d8fa5150db13/users/481b0fddd06444329d618bd0542a01ad/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:30.517318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d73995f18a74bcc98a7d8fa5150db13, user_id=481b0fddd06444329d618bd0542a01ad, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:30.520561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:30.563901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 978/1979] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:30 2022] PUT /identity/v3/projects/7d73995f18a74bcc98a7d8fa5150db13/users/481b0fddd06444329d618bd0542a01ad/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:30.578618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21358-dcbe-4910-b1fe-b76e9f4f8428 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.579521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21358-dcbe-4910-b1fe-b76e9f4f8428 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.579986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b21358-dcbe-4910-b1fe-b76e9f4f8428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:30.619117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-26b21358-dcbe-4910-b1fe-b76e9f4f8428 None None] MFA Rules not processed for user `481b0fddd06444329d618bd0542a01ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:30.621008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-26b21358-dcbe-4910-b1fe-b76e9f4f8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:30.755513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1002/1980] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:30.772866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:30.881315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c75f-cb1b-4310-8491-1cbc1bf7d3d1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:30.886641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4b19f-1a16-4130-9625-3bdfb28f373f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:30.887669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4b19f-1a16-4130-9625-3bdfb28f373f service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:30.900928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4b19f-1a16-4130-9625-3bdfb28f373f service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:30.901497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4b19f-1a16-4130-9625-3bdfb28f373f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:31.049572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4b19f-1a16-4130-9625-3bdfb28f373f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:31.054663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4b19f-1a16-4130-9625-3bdfb28f373f service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:31.073376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 979/1981] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:31.467511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:31.467991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:31.468166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:31.517969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] MFA Rules not processed for user `72cbe87975be4c72ad2208409b1ddf5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:31.518945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:31.598168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:31.704537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1003/1982] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:31.714422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:31.715301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:31.715966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:31.768002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] MFA Rules not processed for user `227e457382a04d19bc3c967e1d3d2a33`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:31.769504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:31.862152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:31.886190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 980/1983] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:31.904653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:31.906083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:32.011556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37866-bb54-4fe7-8251-38b44c217838 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:32.023678 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:32.033429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:32.033768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:32.034053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:32.053563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:32.055826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:32.071951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1004/1984] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:32.805953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:32.815969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8063e9-6035-4b43-871b-649f1477d4dd None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:32.821010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:32.821777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:32.822059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:32.822333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:32.882407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:32.884471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:32.893317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 981/1985] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:33.651264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:33.661576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e101fd-63b2-4c21-9749-71e0b5ff4c40 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:33.665599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b0f8-c6d2-4096-9353-b03051d6d4fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:33.666302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b0f8-c6d2-4096-9353-b03051d6d4fb service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:33.666520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b0f8-c6d2-4096-9353-b03051d6d4fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:33.666748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b0f8-c6d2-4096-9353-b03051d6d4fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:33.688359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b0f8-c6d2-4096-9353-b03051d6d4fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:33.691385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b0f8-c6d2-4096-9353-b03051d6d4fb service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:33.722443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1005/1986] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:33.888571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:34.011653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23605d4-6ebd-469d-96ee-1e7afc3a99e1 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:34.019088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:34.020035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:34.020398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:34.020686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] PATH_INFO: `/v3/users/94a5c6af0a2f4dddb4572678e54f3b5e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:34.022525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a5c6af0a2f4dddb4572678e54f3b5e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:34.025180 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:34.098573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a5c6af0a2f4dddb4572678e54f3b5e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.099269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a5c6af0a2f4dddb4572678e54f3b5e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.119952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a5c6af0a2f4dddb4572678e54f3b5e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.138081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a5c6af0a2f4dddb4572678e54f3b5e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.151219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a5c6af0a2f4dddb4572678e54f3b5e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.166356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 982/1987] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:33 2022] DELETE /identity/v3/users/94a5c6af0a2f4dddb4572678e54f3b5e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:34.171042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:34.171345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:34.171628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:34.193559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:34.194934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:34.263241 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1006/1988] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:34.275799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:34.277880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:34.298873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:34.369878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0b86b-24ee-4998-8a0a-bc6cfb27997e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:34.374244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:34.374971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:34.375371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:34.375720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:34.386954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:34.388422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:34.404255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 983/1989] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:34.720860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:34.722480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:34.735751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c1b9-1af8-46d9-9654-217056b904b6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:34.741593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:34.742871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:34.743310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:34.743773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] PATH_INFO: `/v3/projects/6bc29e917d1c48ec83301cee571a5bb7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:34.745132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc29e917d1c48ec83301cee571a5bb7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:34.747221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:34.783761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:34.798408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc29e917d1c48ec83301cee571a5bb7', 'request_id': 'req-8971c7f7-e080-493a-acc4-83c0eea7d022'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.804662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc29e917d1c48ec83301cee571a5bb7', 'request_id': 'req-8971c7f7-e080-493a-acc4-83c0eea7d022'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.812937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc29e917d1c48ec83301cee571a5bb7', 'request_id': 'req-8971c7f7-e080-493a-acc4-83c0eea7d022'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.825938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] The token cache is being invalidate because project 6bc29e917d1c48ec83301cee571a5bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:34.826224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.826859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.828330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1007/1990] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:34 2022] DELETE /identity/v3/projects/6bc29e917d1c48ec83301cee571a5bb7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:34.832547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:34.843059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad7824-4b26-4803-b2e4-1be333bbc14b service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:34.907781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:34.909754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:34.910285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:34.910821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] PATH_INFO: `/v3/users/7d617c3eed97412b8dabbb7fa64235cc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:34.912291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d617c3eed97412b8dabbb7fa64235cc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:34.915515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:34.983823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d617c3eed97412b8dabbb7fa64235cc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.985472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d617c3eed97412b8dabbb7fa64235cc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:34.998758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d617c3eed97412b8dabbb7fa64235cc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.024328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d617c3eed97412b8dabbb7fa64235cc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.025790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-434a5b7d-e7dd-4a5d-bb01-68bb61b468ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d617c3eed97412b8dabbb7fa64235cc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.041360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 984/1991] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:34 2022] DELETE /identity/v3/users/7d617c3eed97412b8dabbb7fa64235cc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:35.517326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:35.519607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:35.553245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971c7f7-e080-493a-acc4-83c0eea7d022 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:35.692141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:35.693293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:35.694123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:35.694860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] PATH_INFO: `/v3/projects/948a3f19a8fc422eb9c346a8737b4238` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:35.696810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948a3f19a8fc422eb9c346a8737b4238)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:35.702199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:35.771106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948a3f19a8fc422eb9c346a8737b4238', 'request_id': 'req-f39c8524-d77c-47f3-aa01-180cfae17557'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.781714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948a3f19a8fc422eb9c346a8737b4238', 'request_id': 'req-f39c8524-d77c-47f3-aa01-180cfae17557'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.799888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948a3f19a8fc422eb9c346a8737b4238', 'request_id': 'req-f39c8524-d77c-47f3-aa01-180cfae17557'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.840530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] The token cache is being invalidate because project 948a3f19a8fc422eb9c346a8737b4238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:35.840828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.841590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f39c8524-d77c-47f3-aa01-180cfae17557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:35.846502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1008/1992] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:35 2022] DELETE /identity/v3/projects/948a3f19a8fc422eb9c346a8737b4238 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:35.849336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:35.850328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:35.850817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:35.877131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:35.878599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:35.910485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:35.964877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58231641-73a6-452b-a939-01d3b5508914 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:35.965200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58231641-73a6-452b-a939-01d3b5508914 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:35.965457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58231641-73a6-452b-a939-01d3b5508914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:35.969342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 985/1993] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:35.988693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-58231641-73a6-452b-a939-01d3b5508914 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:35.989989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-58231641-73a6-452b-a939-01d3b5508914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:35.999309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1009/1994] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:36.003485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.014255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118b16c-00f0-4b9a-82f9-ee2facd53605 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.020144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.021086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.021564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.022106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.024386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:36.024735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.026405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.087410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 986/1995] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:36.091987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58231641-73a6-452b-a939-01d3b5508914 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.104141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58231641-73a6-452b-a939-01d3b5508914 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.123427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.124058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.124341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.124612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.125306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.137269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.215681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1010/1996] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:36 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:36.220059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.236320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8a70c-2aa8-46f8-8a18-bd2c370d504c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.329881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.330706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.331266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.331688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.332474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.334650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.409789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 987/1997] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:36 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:36.414762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.438647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b41e2-a11d-405f-90c3-537d9627b2d2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.451180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.452020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.452554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.453195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.455000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.456863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.473519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1011/1998] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:36.477675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.493038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69ace-f0be-455e-b8b2-1a5376a6ab5e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.505342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca552e-bd43-46ab-ad28-cc1e4d502694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.505342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca552e-bd43-46ab-ad28-cc1e4d502694 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.505342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca552e-bd43-46ab-ad28-cc1e4d502694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.505342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca552e-bd43-46ab-ad28-cc1e4d502694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.505703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca552e-bd43-46ab-ad28-cc1e4d502694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.505703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca552e-bd43-46ab-ad28-cc1e4d502694 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.513757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 988/1999] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:36.518395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.531537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85ac40-fead-40c5-9a74-bfc46726f1d0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.536767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.537598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.537884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.538164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] PATH_INFO: `/v3/projects/32101c6edd4545828e84f18a1e75098e/users/882aaa74edd54023847aae51e8cdc809/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.542464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:36.558326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32101c6edd4545828e84f18a1e75098e, user_id=882aaa74edd54023847aae51e8cdc809, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.561453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.579721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1012/2000] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:36 2022] PUT /identity/v3/projects/32101c6edd4545828e84f18a1e75098e/users/882aaa74edd54023847aae51e8cdc809/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:36.594644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.594932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.595237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.627699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] MFA Rules not processed for user `882aaa74edd54023847aae51e8cdc809`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:36.629030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:36.734086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 989/2001] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:36.738660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.815215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95670e46-b22e-4b4c-818d-c6fa959ea2e2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.820896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.821816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.822251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.822568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.823381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.825763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.853540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1013/2002] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:36 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:36.857594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.869830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c7d99-bb95-4bad-8286-1321c77b0961 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.894960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:36.929398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.930300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.930300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.930598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.931173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.933225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.955086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 990/2003] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:36 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:36.958932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:36.971372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d66b7-88af-4d1b-a350-f8b7b2dc106e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:36.977151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:36.977932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:36.978225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:36.978507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:36.979180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:36.981648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:36.996622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1014/2004] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:36.997538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.008446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc2155-a59f-4e3d-bffb-6d570257b171 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.013136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.013852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.014264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.014549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] PATH_INFO: `/v3/projects/97ed0b836bf54b8cb057a4140158a3dd/users/3f262539dd3b44f0b62b15afcb8ed0c7/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.032244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ed0b836bf54b8cb057a4140158a3dd, user_id=3f262539dd3b44f0b62b15afcb8ed0c7, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.035472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.050117 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 991/2005] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:36 2022] PUT /identity/v3/projects/97ed0b836bf54b8cb057a4140158a3dd/users/3f262539dd3b44f0b62b15afcb8ed0c7/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:37.054258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.064395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524d009-3fc7-4784-9858-2fca764e63b7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.135610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767667-87a9-4e6f-9407-646744387cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.136402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767667-87a9-4e6f-9407-646744387cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.136823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767667-87a9-4e6f-9407-646744387cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.137138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767667-87a9-4e6f-9407-646744387cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.137804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767667-87a9-4e6f-9407-646744387cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.139544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767667-87a9-4e6f-9407-646744387cd0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.150566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1015/2006] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:37.155639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.168381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3ba48-d84e-4fd4-8971-5a34792ef47f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.174436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.175355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.175827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.177335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] PATH_INFO: `/v3/projects/97ed0b836bf54b8cb057a4140158a3dd/users/3f262539dd3b44f0b62b15afcb8ed0c7/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.180298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97ed0b836bf54b8cb057a4140158a3dd, user_id=3f262539dd3b44f0b62b15afcb8ed0c7, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.185023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.199685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 992/2007] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:37 2022] PUT /identity/v3/projects/97ed0b836bf54b8cb057a4140158a3dd/users/3f262539dd3b44f0b62b15afcb8ed0c7/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:37.212500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.212878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.213778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.247968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] MFA Rules not processed for user `3f262539dd3b44f0b62b15afcb8ed0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:37.249375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:37.310262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:37.345544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1016/2008] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:37.358896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.360722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:37.437186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44d575-e798-4ab5-8c21-7e087d2dcc41 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.438101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd1197-a73a-4c6c-8e33-a2bb6bd9c543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.438854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd1197-a73a-4c6c-8e33-a2bb6bd9c543 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.439133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd1197-a73a-4c6c-8e33-a2bb6bd9c543 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.439401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd1197-a73a-4c6c-8e33-a2bb6bd9c543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.450199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd1197-a73a-4c6c-8e33-a2bb6bd9c543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.451807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd1197-a73a-4c6c-8e33-a2bb6bd9c543 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.462355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 993/2009] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:37.493867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.572321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2582f-3d12-4701-8e59-b600f9bf5f3d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.578195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.579200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.579627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.580039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] PATH_INFO: `/v3/users/882aaa74edd54023847aae51e8cdc809` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.581232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=882aaa74edd54023847aae51e8cdc809)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.583192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.659079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882aaa74edd54023847aae51e8cdc809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.660084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882aaa74edd54023847aae51e8cdc809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.668309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882aaa74edd54023847aae51e8cdc809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.676075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882aaa74edd54023847aae51e8cdc809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.676783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882aaa74edd54023847aae51e8cdc809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.695687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1017/2010] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:37 2022] DELETE /identity/v3/users/882aaa74edd54023847aae51e8cdc809 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:37.700119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.700409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.700684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.720350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:37.721595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:37.783092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 994/2011] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:37.793899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.795426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:37.870651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e0ac7-10d9-44ef-99ac-056e9b7c5dab admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.875956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a98c8f-bc2e-4a5d-8ed2-0075ba8a087d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.876787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a98c8f-bc2e-4a5d-8ed2-0075ba8a087d service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.877163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a98c8f-bc2e-4a5d-8ed2-0075ba8a087d service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.877583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a98c8f-bc2e-4a5d-8ed2-0075ba8a087d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.881698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:37.883951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:37.887934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a98c8f-bc2e-4a5d-8ed2-0075ba8a087d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.889413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a98c8f-bc2e-4a5d-8ed2-0075ba8a087d service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.898085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e350ca1-210c-40c8-8249-708a52dbc478 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:37.898998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1018/2012] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:37.903935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:37.905057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:37.905611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:37.906062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] PATH_INFO: `/v3/users/4c4264c66b2c4628a7258f4424b6cab4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:37.907554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4264c66b2c4628a7258f4424b6cab4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:37.910323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:37.932656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:37.983339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4264c66b2c4628a7258f4424b6cab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.984064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4264c66b2c4628a7258f4424b6cab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:37.993751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4264c66b2c4628a7258f4424b6cab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.009222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4264c66b2c4628a7258f4424b6cab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.009884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4264c66b2c4628a7258f4424b6cab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.024254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 995/2013] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:37 2022] DELETE /identity/v3/users/4c4264c66b2c4628a7258f4424b6cab4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:38.028791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:38.029299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:38.029582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:38.037394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:38.052267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:38.053535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:38.146042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1019/2014] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:38.148820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:38.150422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:38.220449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:38.222061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:38.230505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180433f2-f96f-49f1-9d8e-e631377c672b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:38.234981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:38.235555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:38.235887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:38.236486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:38.244859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a1737-cb96-4344-83f6-97366e6085a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:38.247449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:38.249061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:38.260101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 996/2015] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:38.268621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:38.269424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:38.269775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:38.270137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] PATH_INFO: `/v3/projects/32101c6edd4545828e84f18a1e75098e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:38.271346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32101c6edd4545828e84f18a1e75098e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:38.274022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:38.379065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32101c6edd4545828e84f18a1e75098e', 'request_id': 'req-42f34d0c-4a5e-4249-9a11-bfe72545b569'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.395291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32101c6edd4545828e84f18a1e75098e', 'request_id': 'req-42f34d0c-4a5e-4249-9a11-bfe72545b569'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.419285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32101c6edd4545828e84f18a1e75098e', 'request_id': 'req-42f34d0c-4a5e-4249-9a11-bfe72545b569'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.440972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] The token cache is being invalidate because project 32101c6edd4545828e84f18a1e75098e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:38.441315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.442002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.443797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1020/2016] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:38 2022] DELETE /identity/v3/projects/32101c6edd4545828e84f18a1e75098e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:38.449880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:38.463437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cefe85-b46f-4771-aae7-be392d82baad service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:38.583270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:38.584020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:38.584301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:38.584582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] PATH_INFO: `/v3/users/3f262539dd3b44f0b62b15afcb8ed0c7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:38.590149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f262539dd3b44f0b62b15afcb8ed0c7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:38.590149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:38.662640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:38.675076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f262539dd3b44f0b62b15afcb8ed0c7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.675899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f262539dd3b44f0b62b15afcb8ed0c7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.688358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f262539dd3b44f0b62b15afcb8ed0c7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.706694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f262539dd3b44f0b62b15afcb8ed0c7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.707886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f262539dd3b44f0b62b15afcb8ed0c7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.722076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 997/2017] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:38 2022] DELETE /identity/v3/users/3f262539dd3b44f0b62b15afcb8ed0c7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:38.736428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:38.740733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:38.755617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f34d0c-4a5e-4249-9a11-bfe72545b569 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:38.858458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:38.859262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:38.859597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:38.859949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] PATH_INFO: `/v3/projects/5731dbeb1c934b67951afffb0523cb58` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:38.861492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5731dbeb1c934b67951afffb0523cb58)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:38.863580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:38.910571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:38.933997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5731dbeb1c934b67951afffb0523cb58', 'request_id': 'req-29a4971a-d13f-47a8-9f22-670cdfab4809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.941660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5731dbeb1c934b67951afffb0523cb58', 'request_id': 'req-29a4971a-d13f-47a8-9f22-670cdfab4809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.950275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5731dbeb1c934b67951afffb0523cb58', 'request_id': 'req-29a4971a-d13f-47a8-9f22-670cdfab4809'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.964688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] The token cache is being invalidate because project 5731dbeb1c934b67951afffb0523cb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:38.965505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.966177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:38.967713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1021/2018] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:38 2022] DELETE /identity/v3/projects/5731dbeb1c934b67951afffb0523cb58 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:38.971944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:38.974035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:38.989769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7b5b0-2cff-49db-a275-92f1f6f99ba7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:39.054842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:39.055603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.055956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.056306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] PATH_INFO: `/v3/users/55138fc779f745ac811a67bc9dbd69b2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.057627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55138fc779f745ac811a67bc9dbd69b2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:39.059767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:39.122966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55138fc779f745ac811a67bc9dbd69b2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.124139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55138fc779f745ac811a67bc9dbd69b2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.133773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55138fc779f745ac811a67bc9dbd69b2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.151333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55138fc779f745ac811a67bc9dbd69b2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.152681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55138fc779f745ac811a67bc9dbd69b2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.167059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 998/2019] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:38 2022] DELETE /identity/v3/users/55138fc779f745ac811a67bc9dbd69b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:39.376778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:39.378340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:39.392481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4971a-d13f-47a8-9f22-670cdfab4809 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:39.455736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:39.456790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.457279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.457686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] PATH_INFO: `/v3/projects/97ed0b836bf54b8cb057a4140158a3dd` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.459209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97ed0b836bf54b8cb057a4140158a3dd)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:39.462121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:39.476943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:39.484719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:39.508431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04fd5-62b7-4d11-9b3e-d1e5785790b3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:39.520844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97ed0b836bf54b8cb057a4140158a3dd', 'request_id': 'req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.527733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97ed0b836bf54b8cb057a4140158a3dd', 'request_id': 'req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.535565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97ed0b836bf54b8cb057a4140158a3dd', 'request_id': 'req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.543112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:39.548648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] The token cache is being invalidate because project 97ed0b836bf54b8cb057a4140158a3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:39.549025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.549805 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-cd47aa1e-70e8-48cf-b84a-0618cd200cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.551711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1022/2020] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:39 2022] DELETE /identity/v3/projects/97ed0b836bf54b8cb057a4140158a3dd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:39.558800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483570-c110-4796-a182-9bae7d84907f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.559160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483570-c110-4796-a182-9bae7d84907f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.559511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45483570-c110-4796-a182-9bae7d84907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.578970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:39.580021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.580300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.580575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] PATH_INFO: `/v3/projects/9ec138d881194d21af81b1c9cc72a0b7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.581737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec138d881194d21af81b1c9cc72a0b7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:39.583677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:39.608498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-45483570-c110-4796-a182-9bae7d84907f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:39.610704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-45483570-c110-4796-a182-9bae7d84907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:39.633620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1023/2021] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:39.641452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.641767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.642013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.677373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:39.678683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:39.702076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec138d881194d21af81b1c9cc72a0b7', 'request_id': 'req-e42cd033-d697-4b95-9cdd-4208ab87ffdc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.715669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec138d881194d21af81b1c9cc72a0b7', 'request_id': 'req-e42cd033-d697-4b95-9cdd-4208ab87ffdc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.724234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:39.725774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec138d881194d21af81b1c9cc72a0b7', 'request_id': 'req-e42cd033-d697-4b95-9cdd-4208ab87ffdc'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.740939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] The token cache is being invalidate because project 9ec138d881194d21af81b1c9cc72a0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:39.741435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.742948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.745947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 999/2022] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:39 2022] DELETE /identity/v3/projects/9ec138d881194d21af81b1c9cc72a0b7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:39.748983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:39.750540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:39.783090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1024/2023] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:39.787446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:39.811549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f32c3-9d4f-44ea-9c6c-72ae00789f97 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:39.823123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:39.824453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.825444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.825859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.826688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:39.827329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:39.832466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:39.855638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1025/2024] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:23:39.860420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:39.871415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3849ef-737c-4c0c-8c5a-f770263c6c58 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:39.876690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:39.877333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.877603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.877873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.878554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:39.879122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd033-d697-4b95-9cdd-4208ab87ffdc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:39.880904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:39.884678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:39.885393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:39.885676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:39.885951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] PATH_INFO: `/v3/users/481b0fddd06444329d618bd0542a01ad` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:39.887741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481b0fddd06444329d618bd0542a01ad)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:39.889968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:39.938304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1026/2025] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:39 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:39.940527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:39.992814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481b0fddd06444329d618bd0542a01ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:39.993756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481b0fddd06444329d618bd0542a01ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:40.006222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481b0fddd06444329d618bd0542a01ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:40.025895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:40.030611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481b0fddd06444329d618bd0542a01ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:40.031983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481b0fddd06444329d618bd0542a01ad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:40.055928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1000/2026] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:39 2022] DELETE /identity/v3/users/481b0fddd06444329d618bd0542a01ad => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:40.059982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc320d-725e-49cb-a587-bfbe526066c5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.127908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.128665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.129017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.129402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.130124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.132693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.166285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.167846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:40.169102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1027/2027] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:39 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:40.189952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9fa29-ae8e-41e8-8279-590bc8311403 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.202370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.203074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.203409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.203688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.204971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.206955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.223495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1001/2028] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:40.227731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.237860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c8b9-3c96-42b5-87c9-199189e6c8fd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.243627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4a716-98f1-4450-b255-57f8744f82e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.244248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a716-98f1-4450-b255-57f8744f82e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.244532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a716-98f1-4450-b255-57f8744f82e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.244810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a716-98f1-4450-b255-57f8744f82e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.245882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4a716-98f1-4450-b255-57f8744f82e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.247503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4a716-98f1-4450-b255-57f8744f82e6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.262571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1028/2029] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:40.264296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.274970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6f64d-fe84-4e9c-976f-d69fb1d44fb2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.280189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.280862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.281169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.281450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] PATH_INFO: `/v3/projects/b21b9c9b476a497f813143c8fe74aac7/users/7210418bc640465e98b72765a7a662d2/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.300229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b21b9c9b476a497f813143c8fe74aac7, user_id=7210418bc640465e98b72765a7a662d2, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.303132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.322736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1002/2030] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:40 2022] PUT /identity/v3/projects/b21b9c9b476a497f813143c8fe74aac7/users/7210418bc640465e98b72765a7a662d2/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:40.336280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.336725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.337264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.372232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] MFA Rules not processed for user `7210418bc640465e98b72765a7a662d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:40.373619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:40.399432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:40.473154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1029/2031] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:40.477844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.579233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be7448-5d52-4685-a91d-bf8578f3b74f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.587797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.588433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.588699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.588978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.589797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.592258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.649521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1003/2032] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:40 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:40.651506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.680627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a1ef6-7465-490c-8074-d3a144f40583 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.763688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.763688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.763688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.763688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.764276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.765599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.799976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1030/2033] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:40 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:40.801221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.815884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3775-46d8-4c9f-ba29-a3baf58aff33 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.822534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.823508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.823508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.823687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.824343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.826071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.840340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1004/2034] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:40.844333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.857563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc102c17-4bed-4aa2-9043-8660fce62c11 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:40.863650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:40.864545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:40.864979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:40.865300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] PATH_INFO: `/v3/projects/111506c758fd4dccb7e65ca33e82f779/users/876969dd1d8e4a94a868808fdebd41b5/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:40.887791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=111506c758fd4dccb7e65ca33e82f779, user_id=876969dd1d8e4a94a868808fdebd41b5, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:40.890714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:40.909169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1031/2035] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:40 2022] PUT /identity/v3/projects/111506c758fd4dccb7e65ca33e82f779/users/876969dd1d8e4a94a868808fdebd41b5/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:40.915616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:40.936819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853e967-4461-4188-a489-8a3c33e78808 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.065612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.069173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:41.129057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.130793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.131080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.131357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.132053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.134597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.150912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1005/2036] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:41.152083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.166914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009def7-9a27-4e4f-88ae-31a9036c559a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.172778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a3804-35cb-4849-b43b-5494efc6ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.173868 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3804-35cb-4849-b43b-5494efc6ca76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.174331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3804-35cb-4849-b43b-5494efc6ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.174783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3804-35cb-4849-b43b-5494efc6ca76 admin admin] PATH_INFO: `/v3/projects/111506c758fd4dccb7e65ca33e82f779/users/876969dd1d8e4a94a868808fdebd41b5/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.176980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a3804-35cb-4849-b43b-5494efc6ca76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111506c758fd4dccb7e65ca33e82f779, user_id=876969dd1d8e4a94a868808fdebd41b5, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.183804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a3804-35cb-4849-b43b-5494efc6ca76 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.203171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154700b-e892-4325-829c-7e3a604642fd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.211459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.214012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.214012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.214218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] PATH_INFO: `/v3/projects/7d73995f18a74bcc98a7d8fa5150db13` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.215594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d73995f18a74bcc98a7d8fa5150db13)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.217971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.222335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1006/2037] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:41 2022] PUT /identity/v3/projects/111506c758fd4dccb7e65ca33e82f779/users/876969dd1d8e4a94a868808fdebd41b5/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:41.233825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.234344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.234881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.252404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:41.273832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] MFA Rules not processed for user `876969dd1d8e4a94a868808fdebd41b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:41.275220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:41.281585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:41.306829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d73995f18a74bcc98a7d8fa5150db13', 'request_id': 'req-42beefea-5248-4e0e-827b-4f198205b40d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:41.315071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d73995f18a74bcc98a7d8fa5150db13', 'request_id': 'req-42beefea-5248-4e0e-827b-4f198205b40d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:41.324609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d73995f18a74bcc98a7d8fa5150db13', 'request_id': 'req-42beefea-5248-4e0e-827b-4f198205b40d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:41.341166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] The token cache is being invalidate because project 7d73995f18a74bcc98a7d8fa5150db13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:41.341613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:41.342658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42beefea-5248-4e0e-827b-4f198205b40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:41.345352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1032/2038] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:41 2022] DELETE /identity/v3/projects/7d73995f18a74bcc98a7d8fa5150db13 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:41.349814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64e4ed-4ce9-4e5e-b244-da5938c52218 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.350591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64e4ed-4ce9-4e5e-b244-da5938c52218 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.352030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64e4ed-4ce9-4e5e-b244-da5938c52218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.388356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4b64e4ed-4ce9-4e5e-b244-da5938c52218 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:41.390872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b64e4ed-4ce9-4e5e-b244-da5938c52218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:41.392705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1007/2039] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:41.403081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.404688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:41.484114 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbbe56-3747-4e60-b66f-0dae64d32a3b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.500035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1033/2040] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:41.514293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.514622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.514852 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.539463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:41.540836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:41.550489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1034/2041] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:41.553448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.554209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.554490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.554765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.555477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.566862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89fed0-f231-4aae-95dc-a5dc8c608b76 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.572374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.572981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.573291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.573562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.574206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:41.574505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.576111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.595889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1035/2042] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:41.597102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.612841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0805aaa-2b94-4b31-9059-dac7394d7b95 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.619453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.620128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.620391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.620666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.621327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.624342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.674219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.676436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.682699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:41.685167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1036/2043] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:41.688313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.703903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1008/2044] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:41.764174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723ce20-8be0-4d53-8dc0-c900a76adb56 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.769646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.770524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.781240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.781240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.781240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.781240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.817926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1037/2045] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:41 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:41.822053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.835023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d1c63-eec3-4f41-8a05-c33060d0d1b1 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.841518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.842348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.842683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.842960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.843622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.845336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.856047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1009/2046] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:41.860755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.868959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:41.879179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9533-2dc0-48d7-aa62-edb4af439e89 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.886888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49777996-ee9e-4b65-ae91-e8f50277d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.886888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777996-ee9e-4b65-ae91-e8f50277d46f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.887180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777996-ee9e-4b65-ae91-e8f50277d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.887664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49777996-ee9e-4b65-ae91-e8f50277d46f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.888320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49777996-ee9e-4b65-ae91-e8f50277d46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.889955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49777996-ee9e-4b65-ae91-e8f50277d46f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.903142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1038/2047] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:41.906894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:41.921926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba2f41-388e-4104-a37a-2cb79689b8fc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:41.922860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:41.923611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.923786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.924058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] PATH_INFO: `/v3/projects/1f0ec128e46641349d903c625157c907/users/ec44cffca8074325ba224907d37c2a68/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.940721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0ec128e46641349d903c625157c907, user_id=ec44cffca8074325ba224907d37c2a68, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:41.943882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:41.961675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1010/2048] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:41 2022] PUT /identity/v3/projects/1f0ec128e46641349d903c625157c907/users/ec44cffca8074325ba224907d37c2a68/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:41.966784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:41.967079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:41.967374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:41.987476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:41.988733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:42.061124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1039/2049] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:42.068145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:42.070064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:42.147088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc48e-c251-4f42-8a95-fd2a9d524344 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:42.152315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be354b-56e2-4353-bd27-f4f19af17cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:42.153234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be354b-56e2-4353-bd27-f4f19af17cda service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:42.153613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be354b-56e2-4353-bd27-f4f19af17cda service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:42.154107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be354b-56e2-4353-bd27-f4f19af17cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:42.169366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be354b-56e2-4353-bd27-f4f19af17cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:42.170956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be354b-56e2-4353-bd27-f4f19af17cda service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:42.183927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1011/2050] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:42.228376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:42.230085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:42.245593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b972070-03af-410f-89a7-4e55ef8df46a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:42.253175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:42.253862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:42.254427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:42.254427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] PATH_INFO: `/v3/users/7210418bc640465e98b72765a7a662d2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:42.256083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7210418bc640465e98b72765a7a662d2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:42.259768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:42.340380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7210418bc640465e98b72765a7a662d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:42.340958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7210418bc640465e98b72765a7a662d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:42.357161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7210418bc640465e98b72765a7a662d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:42.368234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7210418bc640465e98b72765a7a662d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:42.370303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7210418bc640465e98b72765a7a662d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:42.405157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1040/2051] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:42 2022] DELETE /identity/v3/users/7210418bc640465e98b72765a7a662d2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:42.406680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134613a-85bf-4769-b131-523b4bb9c995 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:42.406965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134613a-85bf-4769-b131-523b4bb9c995 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:42.407238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134613a-85bf-4769-b131-523b4bb9c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:42.430448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0134613a-85bf-4769-b131-523b4bb9c995 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:42.431671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0134613a-85bf-4769-b131-523b4bb9c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:42.527598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1012/2052] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:42.544041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:42.545548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:42.657140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43fc6f-574b-4d3f-9856-326433894d38 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:42.661312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:42.662003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:42.662389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:42.663077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:42.674890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:42.675388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:42.689160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1041/2053] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:43.220888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:43.221394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:43.221517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:43.235304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:43.236896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:43.255860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ba5dc-61ef-4a6e-93a2-95fac94f33b8 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:43.264896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:43.267058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:43.279880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:43.280491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] PATH_INFO: `/v3/projects/b21b9c9b476a497f813143c8fe74aac7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:43.282085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b21b9c9b476a497f813143c8fe74aac7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:43.285637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:43.286248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] MFA Rules not processed for user `ec44cffca8074325ba224907d37c2a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:43.287749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:43.289187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:43.353395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b21b9c9b476a497f813143c8fe74aac7', 'request_id': 'req-35b65521-b693-4c0d-a28e-5c4ce7be5b41'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.356950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:43.360696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b21b9c9b476a497f813143c8fe74aac7', 'request_id': 'req-35b65521-b693-4c0d-a28e-5c4ce7be5b41'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.368635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1013/2054] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:43.370763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b21b9c9b476a497f813143c8fe74aac7', 'request_id': 'req-35b65521-b693-4c0d-a28e-5c4ce7be5b41'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.381162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:43.383043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:43.383910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] The token cache is being invalidate because project b21b9c9b476a497f813143c8fe74aac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:43.384636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.385329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.386919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1042/2055] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:43 2022] DELETE /identity/v3/projects/b21b9c9b476a497f813143c8fe74aac7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:43.390992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:43.393098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:43.485213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a5fd2-6db9-41d9-bca3-a5bebc12d99c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:43.486948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b65521-b693-4c0d-a28e-5c4ce7be5b41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:43.492858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:43.493663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:43.494070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:43.494417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] PATH_INFO: `/v3/users/876969dd1d8e4a94a868808fdebd41b5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:43.495770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=876969dd1d8e4a94a868808fdebd41b5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:43.497716 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:43.547818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:43.548529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:43.548878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:43.549256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:43.551105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:43.552399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876969dd1d8e4a94a868808fdebd41b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.553055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876969dd1d8e4a94a868808fdebd41b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.560566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876969dd1d8e4a94a868808fdebd41b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.568461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876969dd1d8e4a94a868808fdebd41b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.569381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876969dd1d8e4a94a868808fdebd41b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:43.596582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1043/2056] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:43 2022] DELETE /identity/v3/users/876969dd1d8e4a94a868808fdebd41b5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:43.622557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:43.624085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff43d5a-5bcc-46cc-9edd-ccd7e5d00ec4 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:43.634211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1014/2057] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:43.915398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:43.915398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:43.939123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:44.010861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30d4c0-27e3-4648-a7c9-8f69de5e1bdc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.016757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.017276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.017486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.017808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] PATH_INFO: `/v3/projects/111506c758fd4dccb7e65ca33e82f779` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.019062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111506c758fd4dccb7e65ca33e82f779)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.021157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.079464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111506c758fd4dccb7e65ca33e82f779', 'request_id': 'req-10f7a57f-7928-4d88-9831-25c6725ec838'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:44.086493 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111506c758fd4dccb7e65ca33e82f779', 'request_id': 'req-10f7a57f-7928-4d88-9831-25c6725ec838'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:44.093358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111506c758fd4dccb7e65ca33e82f779', 'request_id': 'req-10f7a57f-7928-4d88-9831-25c6725ec838'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:44.104953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] The token cache is being invalidate because project 111506c758fd4dccb7e65ca33e82f779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:44.105281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:44.106040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-10f7a57f-7928-4d88-9831-25c6725ec838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:44.108015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1044/2058] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:43 2022] DELETE /identity/v3/projects/111506c758fd4dccb7e65ca33e82f779 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:44.113405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.113810 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.114223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.135076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:44.136332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:44.197956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1015/2059] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:44.205683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.205970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.206251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.230037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:44.231174 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:44.240421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1045/2060] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:44.245161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.263469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4e92d-b546-4363-b7cb-3e5a880dcbdf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.268276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.268965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.269342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.269621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.270266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:44.270569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.272173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.274622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:44.287034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1016/2061] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:44.292081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.302651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f70538-eaeb-4980-8c7c-654fe1257474 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.308101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.308835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.312215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.312215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.312215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.313388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.350460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1046/2062] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:44 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:44.351314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.359648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276e049-2f7a-4aba-a8e0-3278c06141c0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.423756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.424370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.424687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.424963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.425642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.427566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.453828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1017/2063] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:44 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:44.455041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.465579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7d944-e350-44ac-b7f4-26338680d4c9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.470187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.470782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.471063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.471335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.471972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.473627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.487139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1047/2064] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:44.488275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.498679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5d803-aa1a-4e33-9746-1d93f362aa40 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.503394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573ad31-8a5d-492c-b2b2-920686e52577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.504004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573ad31-8a5d-492c-b2b2-920686e52577 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.504283 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573ad31-8a5d-492c-b2b2-920686e52577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.504556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573ad31-8a5d-492c-b2b2-920686e52577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.505299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573ad31-8a5d-492c-b2b2-920686e52577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.507573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573ad31-8a5d-492c-b2b2-920686e52577 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.518386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1018/2065] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:44.522543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.532752 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cc041-2b8a-4d59-b75d-58e6c4189abb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.537832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.539024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.539286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.539608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] PATH_INFO: `/v3/projects/60bf17342d5e4075b63d3af8d4f26094/users/48ddc6d8ff8a4c6eb21d87775fbdf692/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.555426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bf17342d5e4075b63d3af8d4f26094, user_id=48ddc6d8ff8a4c6eb21d87775fbdf692, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.558188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.573293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1048/2066] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:44 2022] PUT /identity/v3/projects/60bf17342d5e4075b63d3af8d4f26094/users/48ddc6d8ff8a4c6eb21d87775fbdf692/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:44.585074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38846297-e3b9-4dd0-af64-3ebcd057a359 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.585661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38846297-e3b9-4dd0-af64-3ebcd057a359 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.586084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38846297-e3b9-4dd0-af64-3ebcd057a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.634915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-38846297-e3b9-4dd0-af64-3ebcd057a359 None None] MFA Rules not processed for user `48ddc6d8ff8a4c6eb21d87775fbdf692`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:44.636229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-38846297-e3b9-4dd0-af64-3ebcd057a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:44.714711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1019/2067] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:44.726571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:44.728607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:44.775143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:44.795570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f9cd4-142e-468b-ab45-a712ad5222f0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:44.799404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790176bd-6a16-4f36-919f-9e5b9d6831bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:44.800115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790176bd-6a16-4f36-919f-9e5b9d6831bb service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:44.800397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790176bd-6a16-4f36-919f-9e5b9d6831bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:44.800696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790176bd-6a16-4f36-919f-9e5b9d6831bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:44.810597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790176bd-6a16-4f36-919f-9e5b9d6831bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:44.812070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790176bd-6a16-4f36-919f-9e5b9d6831bb service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:44.825995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1049/2068] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:45.139760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221bdba-caa8-4d8e-ba45-fb98e68b11b8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:45.139965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221bdba-caa8-4d8e-ba45-fb98e68b11b8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:45.140240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221bdba-caa8-4d8e-ba45-fb98e68b11b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:45.160416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4221bdba-caa8-4d8e-ba45-fb98e68b11b8 None None] MFA Rules not processed for user `ec44cffca8074325ba224907d37c2a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:45.171630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4221bdba-caa8-4d8e-ba45-fb98e68b11b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:45.285508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1020/2069] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:49.118966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1d57-d939-422a-8f1f-d0d1141f9633 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:49.119530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1d57-d939-422a-8f1f-d0d1141f9633 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:49.119530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b1d57-d939-422a-8f1f-d0d1141f9633 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:49.120908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1050/2070] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:23:49.160430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:49.161027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:49.161027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:49.174998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:49.182403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:49.183606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:49.250397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1021/2071] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:23:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:49.436568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b1d57-d939-422a-8f1f-d0d1141f9633 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:49.438595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1f3b1d57-d939-422a-8f1f-d0d1141f9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:49.463330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b1d57-d939-422a-8f1f-d0d1141f9633 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:49.470780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782db5-0356-43f7-9287-846e0578355f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:49.471409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782db5-0356-43f7-9287-846e0578355f service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:49.471834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782db5-0356-43f7-9287-846e0578355f service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:49.472115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782db5-0356-43f7-9287-846e0578355f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:49.484817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82782db5-0356-43f7-9287-846e0578355f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:49.486499 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82782db5-0356-43f7-9287-846e0578355f service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:49.504866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1051/2072] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:49.551213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:49.554790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:49.716458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fe1b-e8cf-4966-8f7f-e8c611e9dac4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:49.722903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:49.723637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:49.723828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:49.724181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] PATH_INFO: `/v3/users/f78dfe819ddb47928a9c37ca768147aa` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:49.727441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f78dfe819ddb47928a9c37ca768147aa)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:49.729404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:49.794991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f78dfe819ddb47928a9c37ca768147aa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:49.795748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f78dfe819ddb47928a9c37ca768147aa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:49.803353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f78dfe819ddb47928a9c37ca768147aa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:49.828294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f78dfe819ddb47928a9c37ca768147aa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:49.828294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27531baa-fe46-4cf6-8c53-f006eb145257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f78dfe819ddb47928a9c37ca768147aa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:49.836497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1022/2073] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:49 2022] DELETE /identity/v3/users/f78dfe819ddb47928a9c37ca768147aa => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:50.019959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782db5-0356-43f7-9287-846e0578355f service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.043414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782db5-0356-43f7-9287-846e0578355f service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.109854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.110496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.110779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.111056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] PATH_INFO: `/v3/projects/4446226b91c84390ad55d5366e4b5eca` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.112172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4446226b91c84390ad55d5366e4b5eca)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.114109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.162536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4446226b91c84390ad55d5366e4b5eca', 'request_id': 'req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.168382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4446226b91c84390ad55d5366e4b5eca', 'request_id': 'req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.176026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4446226b91c84390ad55d5366e4b5eca', 'request_id': 'req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.188505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] The token cache is being invalidate because project 4446226b91c84390ad55d5366e4b5eca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:50.189289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.189432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5a01f3d5-af5a-4b78-a66d-9302cc067a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.190934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1052/2074] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:50 2022] DELETE /identity/v3/projects/4446226b91c84390ad55d5366e4b5eca => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:50.196360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.196839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.196994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.217758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:50.219064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:50.237427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:50.285294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1023/2075] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:50.293137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.293454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.293736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.314254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:50.315391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:50.324141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1053/2076] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:50.328486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.338792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68646f5-ddb0-4480-bc7c-2b2c8c050451 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.343354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.343968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.344248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.344521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.345198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:50.345503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.347100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.363157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1024/2077] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:50.364572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.374509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39b456-1df5-430a-822d-515a0fc7c65c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.379755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.380389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.380665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.380936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.381633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.384264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.414474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1054/2078] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:50.418732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.428619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977a02-3324-4ce8-9bc8-2dfd9153e5b5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.487723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.488339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.488624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.488901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.489569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.491566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.522655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1025/2079] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:50.526825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.538870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8bbf8-742e-4997-afe8-d084b210cdfc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.544952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.545702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.545981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.546253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.546893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.548491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.561830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1055/2080] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:50.563266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.574088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c141f21-74a1-4a29-9d92-ff89f680c52f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.578693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6682f8-a73f-4b7b-84f7-7cb0b4ed80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.579293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6682f8-a73f-4b7b-84f7-7cb0b4ed80ec admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.579635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6682f8-a73f-4b7b-84f7-7cb0b4ed80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.579912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6682f8-a73f-4b7b-84f7-7cb0b4ed80ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.580721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6682f8-a73f-4b7b-84f7-7cb0b4ed80ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.582341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6682f8-a73f-4b7b-84f7-7cb0b4ed80ec admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.596437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1026/2081] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:50.601444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.613749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd3d41-995b-4c46-8281-109b00b4be6b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.619404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.620124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.620714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.621002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] PATH_INFO: `/v3/projects/8b5de8f791b74eb38033e91a0caacb14/users/3acde27a89734a268c82731114bd4baf/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.659915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5de8f791b74eb38033e91a0caacb14, user_id=3acde27a89734a268c82731114bd4baf, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.662717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.665494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:50.684903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1056/2082] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:50 2022] PUT /identity/v3/projects/8b5de8f791b74eb38033e91a0caacb14/users/3acde27a89734a268c82731114bd4baf/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:50.695906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.696303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.696689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.730971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] MFA Rules not processed for user `3acde27a89734a268c82731114bd4baf`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:50.732197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:50.764445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.766494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:50.812372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1027/2083] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:50.817085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.842340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:50.852862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825791c-74f6-4d99-8c2c-8cf5e21a1019 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.859849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.860487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.860764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.861035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] PATH_INFO: `/v3/users/48ddc6d8ff8a4c6eb21d87775fbdf692` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.862274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ddc6d8ff8a4c6eb21d87775fbdf692)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.864615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.915530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14616-3966-40ac-a5fd-3238f55fe66d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:50.921523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:50.922314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.922624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.922981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:50.923761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:50.925618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:50.942820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ddc6d8ff8a4c6eb21d87775fbdf692'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.943536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ddc6d8ff8a4c6eb21d87775fbdf692'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.952125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ddc6d8ff8a4c6eb21d87775fbdf692'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.956785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1028/2084] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:50.961704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:50.965651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ddc6d8ff8a4c6eb21d87775fbdf692'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.966407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c91805b8-5936-404f-8c8a-6d77e391aa0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ddc6d8ff8a4c6eb21d87775fbdf692'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:50.985209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1057/2085] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:50 2022] DELETE /identity/v3/users/48ddc6d8ff8a4c6eb21d87775fbdf692 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:50.989622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:50.989939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:50.990217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.013145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:51.014391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.041655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0fcd-9959-47ae-9336-1dd7c1befcb4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.096080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1058/2086] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:51.105985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.108557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.119246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.119933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.120219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.120475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.121131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.123087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.127301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:51.148609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1029/2087] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:50 2022] POST /identity/v3/users => generated 306 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:51.152951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.154687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.167388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee6d0-dd8b-41c7-adeb-472bb9e33e2f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.174026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.174649 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.174943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.175216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.175914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.177594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.179564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e783a3-2599-4ca3-9e3b-ed2fd024098c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.185179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.186252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.187175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.187622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.192938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1030/2088] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:51.197424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.198780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.200338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.209545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df5325-f2ab-41dc-9761-85c5f5c0075c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.210507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1059/2089] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:51.214351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.215016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.215536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.215827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] PATH_INFO: `/v3/projects/0480ec37c1654f8bb5a82e534861c73d/users/5fce27acadb648c4b72858d722133fd8/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.234803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0480ec37c1654f8bb5a82e534861c73d, user_id=5fce27acadb648c4b72858d722133fd8, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.238367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.254735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1031/2090] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:51 2022] PUT /identity/v3/projects/0480ec37c1654f8bb5a82e534861c73d/users/5fce27acadb648c4b72858d722133fd8/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:51.259566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.270081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9929a-5daa-4121-b333-0e58cd696e84 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.335905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf82a1-9491-4270-ae50-e24cd8ac6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.337006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf82a1-9491-4270-ae50-e24cd8ac6981 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.337321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf82a1-9491-4270-ae50-e24cd8ac6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.337600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf82a1-9491-4270-ae50-e24cd8ac6981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.338258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf82a1-9491-4270-ae50-e24cd8ac6981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.339882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf82a1-9491-4270-ae50-e24cd8ac6981 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.350146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1060/2091] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:51.354880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.362159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:51.366371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7c03e-bb82-40a5-943c-95166ee2d88c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.373316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.373745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.374033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.374318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] PATH_INFO: `/v3/projects/0480ec37c1654f8bb5a82e534861c73d/users/5fce27acadb648c4b72858d722133fd8/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.376295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0480ec37c1654f8bb5a82e534861c73d, user_id=5fce27acadb648c4b72858d722133fd8, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.379358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.390854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1032/2092] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:51 2022] PUT /identity/v3/projects/0480ec37c1654f8bb5a82e534861c73d/users/5fce27acadb648c4b72858d722133fd8/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:51.402424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.402711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.402990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.433741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] MFA Rules not processed for user `5fce27acadb648c4b72858d722133fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:51.435077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.532723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1061/2093] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:51 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:51.543911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.547812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.611265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.612758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.630264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3491cb-e96a-43bd-ac2d-d471520b83d3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.634445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.635151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.635498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.635832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.656693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.658757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.668817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:51.670435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1033/2094] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:51 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:51.693809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc607f31-be67-4189-b4ae-7cbc27d9c7a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.698681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.699402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.699774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.700122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] PATH_INFO: `/v3/projects/60bf17342d5e4075b63d3af8d4f26094` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.701350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bf17342d5e4075b63d3af8d4f26094)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.703463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.770560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bf17342d5e4075b63d3af8d4f26094', 'request_id': 'req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:51.773287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.781676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bf17342d5e4075b63d3af8d4f26094', 'request_id': 'req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:51.785640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a03d5-1e59-4763-880b-ff629a8d598b service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.793378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bf17342d5e4075b63d3af8d4f26094', 'request_id': 'req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:51.805788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] The token cache is being invalidate because project 60bf17342d5e4075b63d3af8d4f26094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:51.806077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:51.806821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c4573b5-2a67-4f16-a5eb-e19e5cba9532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:51.808829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1062/2095] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:51 2022] DELETE /identity/v3/projects/60bf17342d5e4075b63d3af8d4f26094 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:51.813293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea0bf-3148-4551-92c9-85a0662e5d51 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.813581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea0bf-3148-4551-92c9-85a0662e5d51 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.813857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea0bf-3148-4551-92c9-85a0662e5d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.833730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4c8ea0bf-3148-4551-92c9-85a0662e5d51 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:51.834971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4c8ea0bf-3148-4551-92c9-85a0662e5d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.838477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.839174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.839562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.839834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.841622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.899972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1063/2096] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:23:51.906250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.907724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:51.909293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.909902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.910247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.920572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1034/2097] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:51 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:23:51.937156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:51.938443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:51.947721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1064/2098] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:51.951722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:51.967495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a80bc8-9396-40d8-84da-ef1f2167a90f service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:51.978340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:51.978981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:51.979246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:51.979512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:51.980933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:51.981268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:51.983053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.006348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1035/2099] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:52.010689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:52.024644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4525e-61d9-4b71-94cb-373468c2f6f9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:52.030274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:52.031721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.032016 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.032290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.032936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:52.035153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.077607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1065/2100] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:52 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:52.079072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:52.094402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9cf3f-db6c-426e-9d31-b0a99f5b4fc5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:52.170770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:52.227115 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:52.227764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.228155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.229033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.229903 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:52.231916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.261473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1036/2101] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:52 2022] POST /identity/v3/users => generated 282 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:52.265776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:52.278983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f22664-2159-4871-afea-f30ee07ca6fe admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:52.289035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:52.290168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.290544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.291362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.292075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:52.293970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.313187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1066/2102] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:52.315442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:52.327939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9fa32-21f7-456d-9cbd-90f2398da637 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:52.333368 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011d8a8-ec23-4692-aaef-4dcd3c21c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:52.334082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011d8a8-ec23-4692-aaef-4dcd3c21c255 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.334459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011d8a8-ec23-4692-aaef-4dcd3c21c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.334915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011d8a8-ec23-4692-aaef-4dcd3c21c255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.335700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011d8a8-ec23-4692-aaef-4dcd3c21c255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:52.337577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011d8a8-ec23-4692-aaef-4dcd3c21c255 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.353736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1037/2103] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:23:52.355141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:52.382849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a6e59-2561-4d04-a62b-94ca4308092f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:52.389780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:52.391252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.391548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.391837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] PATH_INFO: `/v3/projects/2884aba72ca740a3ac59f38972f69c9e/users/af8b07440ec243969369b003c836f636/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.420739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2884aba72ca740a3ac59f38972f69c9e, user_id=af8b07440ec243969369b003c836f636, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:52.424219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.438291 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1067/2104] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:52 2022] PUT /identity/v3/projects/2884aba72ca740a3ac59f38972f69c9e/users/af8b07440ec243969369b003c836f636/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:52.449459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.449746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.450018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.479280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] MFA Rules not processed for user `af8b07440ec243969369b003c836f636`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:52.480697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:52.553502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1038/2105] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:52.566673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:52.568429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:52.580537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:52.651952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4d057-d78e-4f1e-a599-e698c59d560e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:52.655662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:52.656272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:52.656572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:52.656904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:52.666893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:52.668324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:52.678584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1068/2106] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:54.160346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:54.170951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61832-126e-4ab7-b03b-7be83ddcd64f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:54.174687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:54.175288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:54.175569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:54.175840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:54.177616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:54.255303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:54.256784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72210fa7-34d5-4df4-a146-b33ae9f3cc69 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:54.266827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1039/2107] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:56.174279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:56.175729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:56.246357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c811-3391-4a4d-a8c2-f90b6b1b3993 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:56.250888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:56.251518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:56.251799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:56.252077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] PATH_INFO: `/v3/users/3acde27a89734a268c82731114bd4baf` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:56.253229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acde27a89734a268c82731114bd4baf)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:56.255165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:56.303435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acde27a89734a268c82731114bd4baf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:56.304356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acde27a89734a268c82731114bd4baf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:56.311497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acde27a89734a268c82731114bd4baf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:56.318327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acde27a89734a268c82731114bd4baf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:56.318999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acde27a89734a268c82731114bd4baf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:56.337039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1069/2108] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:56 2022] DELETE /identity/v3/users/3acde27a89734a268c82731114bd4baf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:56.341532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:56.342022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:56.342119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:56.360587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:56.361807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:56.394219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:56.422210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1040/2109] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:56.431803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:56.433218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:56.465129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:56.493844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ae834-8e82-42c2-842a-2f741325151a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:56.497516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:56.498125 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:56.498406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:56.498682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:56.507470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:56.508908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:56.518208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1070/2110] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:57.203626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:57.205301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:57.233630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54ca20-ae5c-40e0-bd12-90841bc51636 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:57.239047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:57.239684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:57.240137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:57.240584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] PATH_INFO: `/v3/projects/8b5de8f791b74eb38033e91a0caacb14` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:57.242250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5de8f791b74eb38033e91a0caacb14)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:57.244182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:57.309295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5de8f791b74eb38033e91a0caacb14', 'request_id': 'req-29a1ebe9-d43d-4691-b3a0-fff162ab710a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.319129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5de8f791b74eb38033e91a0caacb14', 'request_id': 'req-29a1ebe9-d43d-4691-b3a0-fff162ab710a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.329878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5de8f791b74eb38033e91a0caacb14', 'request_id': 'req-29a1ebe9-d43d-4691-b3a0-fff162ab710a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.342506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] The token cache is being invalidate because project 8b5de8f791b74eb38033e91a0caacb14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:57.343119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.343703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.345568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1041/2111] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:57 2022] DELETE /identity/v3/projects/8b5de8f791b74eb38033e91a0caacb14 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:57.350007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:57.361721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48312-6570-4011-be8a-cef7818e9976 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:57.427211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:57.429927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:57.430343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:57.430622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] PATH_INFO: `/v3/users/5fce27acadb648c4b72858d722133fd8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:57.432051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fce27acadb648c4b72858d722133fd8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:57.434039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:57.488599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fce27acadb648c4b72858d722133fd8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.489311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fce27acadb648c4b72858d722133fd8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.496712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fce27acadb648c4b72858d722133fd8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.504120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fce27acadb648c4b72858d722133fd8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.504919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b9abf014-4b5d-4bce-a8ec-4ca5b4869b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fce27acadb648c4b72858d722133fd8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.523504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1071/2112] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:23:57 2022] DELETE /identity/v3/users/5fce27acadb648c4b72858d722133fd8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:57.803063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:57.805047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:57.818105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1ebe9-d43d-4691-b3a0-fff162ab710a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:57.876755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:57.877415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:57.877697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:57.877973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] PATH_INFO: `/v3/projects/0480ec37c1654f8bb5a82e534861c73d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:57.879079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0480ec37c1654f8bb5a82e534861c73d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:57.881007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:57.926908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0480ec37c1654f8bb5a82e534861c73d', 'request_id': 'req-0b931445-33f2-48f8-a1e6-f371bf794af0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.933423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0480ec37c1654f8bb5a82e534861c73d', 'request_id': 'req-0b931445-33f2-48f8-a1e6-f371bf794af0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.939666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0480ec37c1654f8bb5a82e534861c73d', 'request_id': 'req-0b931445-33f2-48f8-a1e6-f371bf794af0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.941673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:57.953166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] The token cache is being invalidate because project 0480ec37c1654f8bb5a82e534861c73d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:23:57.953460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.954103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0b931445-33f2-48f8-a1e6-f371bf794af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:23:57.955582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1042/2113] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:23:57 2022] DELETE /identity/v3/projects/0480ec37c1654f8bb5a82e534861c73d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:57.962727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:57.963609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:57.963955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:57.987087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:57.987936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:58.035576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:58.052570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1072/2114] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:58.060287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.060597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.060874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.081266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:58.082461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:58.090664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1043/2115] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:58.094978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.104971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df59ba-858a-4e65-ac02-41ef38cfe654 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.109952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.110681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.110937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.111308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.112027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:23:58.112389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.114460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.126912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1073/2116] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:23:58.131517 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.141706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9befd-d71c-49d6-a9f4-5079126e06a8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.146783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.147450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.147734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.148003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.148735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.150730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.181584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1044/2117] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:58 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:58.186726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.198792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2026c-18e9-4f4a-ab01-2a0ad6688582 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.292154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.292992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.293518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.293994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.294803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.297154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.335542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1074/2118] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:58 2022] POST /identity/v3/users => generated 305 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:23:58.336917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.354242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dc457-559c-4ceb-a52c-3ccda41c621d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.374588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.375216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.375492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.375764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.382776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.384930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.404148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1045/2119] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:58.408825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.421631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92c8b-a200-4dc3-b339-5857d9ae7b90 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.427115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5a967-799c-4bc2-8f42-3b42587d5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.427738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a967-799c-4bc2-8f42-3b42587d5384 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.428024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a967-799c-4bc2-8f42-3b42587d5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.428299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a967-799c-4bc2-8f42-3b42587d5384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.429800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5a967-799c-4bc2-8f42-3b42587d5384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.431698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5a967-799c-4bc2-8f42-3b42587d5384 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.449862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1075/2120] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:58.451504 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.467015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d67a37-1f5e-4af0-8aa8-4b8bced6c60d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.476296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.477571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.478021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.478536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] PATH_INFO: `/v3/projects/58dda5feca014a20bd4b3d90ec4ff903/users/bd9a601a135140348b8d80831c206fef/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.508570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58dda5feca014a20bd4b3d90ec4ff903, user_id=bd9a601a135140348b8d80831c206fef, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.511559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.529371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1046/2121] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:58 2022] PUT /identity/v3/projects/58dda5feca014a20bd4b3d90ec4ff903/users/bd9a601a135140348b8d80831c206fef/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:58.539872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.539872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.539872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.568885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] MFA Rules not processed for user `bd9a601a135140348b8d80831c206fef`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:58.572721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:58.655329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1076/2122] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:58 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:58.660866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.738491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e3e12-9146-4e26-898f-f142432a3836 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.745964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.746814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.747615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.748132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.748524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.750483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.785145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1047/2123] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:23:58 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:58.786489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.797842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3462c79-dc4a-4447-9619-669e2f8dd61f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.842588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:58.863840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.863840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.863840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.863840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.864299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.866243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.892154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1077/2124] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:23:58 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:23:58.893596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.904468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c7fb-d56d-48da-84fd-e8d214ce37f2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.909366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.910441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.910795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.911141 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.911864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.913722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.924970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1048/2125] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:58.930332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.941580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fada-8e54-4a69-89a1-1f095dc8d835 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:58.947366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:58.948036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:58.948317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:58.948625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] PATH_INFO: `/v3/projects/107b0551864f423c9198f0d814a6026c/users/86b3d5160cab4a51b3632fe8918f9b69/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:58.964591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=107b0551864f423c9198f0d814a6026c, user_id=86b3d5160cab4a51b3632fe8918f9b69, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:58.967335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:58.980975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1078/2126] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:58 2022] PUT /identity/v3/projects/107b0551864f423c9198f0d814a6026c/users/86b3d5160cab4a51b3632fe8918f9b69/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:23:58.984992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:58.995165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a763d-cc74-4727-a85f-a5ceb0789721 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:59.058307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3c4ca-6768-4fa9-8ec1-d8f843c57a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:59.058933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3c4ca-6768-4fa9-8ec1-d8f843c57a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:59.059244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3c4ca-6768-4fa9-8ec1-d8f843c57a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:59.059528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3c4ca-6768-4fa9-8ec1-d8f843c57a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:59.060308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3c4ca-6768-4fa9-8ec1-d8f843c57a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:59.061976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3c4ca-6768-4fa9-8ec1-d8f843c57a96 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:59.064585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:23:59.075710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1049/2127] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:23:59.079309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:59.091305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0093-f1b9-4a1c-a1f7-f93f249a8b9c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:59.096380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:59.097048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:59.097363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:59.097643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] PATH_INFO: `/v3/projects/107b0551864f423c9198f0d814a6026c/users/86b3d5160cab4a51b3632fe8918f9b69/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:59.099537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107b0551864f423c9198f0d814a6026c, user_id=86b3d5160cab4a51b3632fe8918f9b69, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:59.102819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:59.113212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1079/2128] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:23:59 2022] PUT /identity/v3/projects/107b0551864f423c9198f0d814a6026c/users/86b3d5160cab4a51b3632fe8918f9b69/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:23:59.124342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:59.124626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:59.124917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:59.154100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] MFA Rules not processed for user `86b3d5160cab4a51b3632fe8918f9b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:23:59.155505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:59.226785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1050/2129] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:23:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:23:59.238583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:59.240330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:23:59.302789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e357e77-6552-4f2e-b224-56345aa0a087 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:59.307032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:59.307653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:59.307938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:59.308210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:59.318460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:59.320449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:59.333343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1080/2130] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:23:59.503291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:23:59.515716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a2ba3-6783-4627-9af8-78e6d8b2e7c6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:23:59.521042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f718b5c-6067-4234-b56d-d52ccaea1ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:23:59.521794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718b5c-6067-4234-b56d-d52ccaea1ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:23:59.522265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718b5c-6067-4234-b56d-d52ccaea1ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:23:59.522696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f718b5c-6067-4234-b56d-d52ccaea1ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:23:59.613942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f718b5c-6067-4234-b56d-d52ccaea1ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:23:59.616712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f718b5c-6067-4234-b56d-d52ccaea1ca5 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:23:59.628623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1051/2131] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:23:59 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:05.121431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:05.186631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744e929-d11a-4fb1-b337-e3bf4a62d192 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:05.191719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:05.192485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:05.192767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:05.193046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] PATH_INFO: `/v3/users/bd9a601a135140348b8d80831c206fef` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:05.194221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9a601a135140348b8d80831c206fef)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:05.196137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:05.243246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:05.249590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9a601a135140348b8d80831c206fef'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:05.250652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9a601a135140348b8d80831c206fef'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:05.258878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9a601a135140348b8d80831c206fef'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:05.269331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9a601a135140348b8d80831c206fef'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:05.270055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9a601a135140348b8d80831c206fef'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:05.291094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1081/2132] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:05 2022] DELETE /identity/v3/users/bd9a601a135140348b8d80831c206fef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:05.295599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:05.296062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:05.296185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:05.318217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:05.319597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:05.381959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1052/2133] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:05.391812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:05.393480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:05.455431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c2148-f8c5-4058-86e4-e3581326e21f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:05.457534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:05.458155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:05.458432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:05.458906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:05.469081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:05.473207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:05.482781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1082/2134] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:05.965530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:05.966992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:05.984829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26e1a-9e9e-4fb3-964f-070b906b7d24 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:06.001997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:06.002657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.002929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.003254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] PATH_INFO: `/v3/projects/58dda5feca014a20bd4b3d90ec4ff903` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.004480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58dda5feca014a20bd4b3d90ec4ff903)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:06.007296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:06.025293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:06.057462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58dda5feca014a20bd4b3d90ec4ff903', 'request_id': 'req-b05bb8b0-08df-4cfe-b648-e0aeeb625018'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.065050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58dda5feca014a20bd4b3d90ec4ff903', 'request_id': 'req-b05bb8b0-08df-4cfe-b648-e0aeeb625018'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.071806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58dda5feca014a20bd4b3d90ec4ff903', 'request_id': 'req-b05bb8b0-08df-4cfe-b648-e0aeeb625018'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.082391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] The token cache is being invalidate because project 58dda5feca014a20bd4b3d90ec4ff903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:06.082750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.083592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.085560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1053/2135] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:05 2022] DELETE /identity/v3/projects/58dda5feca014a20bd4b3d90ec4ff903 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:06.090012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:06.102539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1db4c4-2292-4682-92f8-858c87dd9702 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:06.157694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:06.158330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.158503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.158772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] PATH_INFO: `/v3/users/86b3d5160cab4a51b3632fe8918f9b69` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.160135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b3d5160cab4a51b3632fe8918f9b69)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:06.162073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:06.208779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b3d5160cab4a51b3632fe8918f9b69'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.209442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b3d5160cab4a51b3632fe8918f9b69'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.216450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b3d5160cab4a51b3632fe8918f9b69'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.223939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b3d5160cab4a51b3632fe8918f9b69'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.224569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2bf76e41-d613-4b1a-9524-907c081d6bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b3d5160cab4a51b3632fe8918f9b69'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.226304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:06.246886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1083/2136] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:06 2022] DELETE /identity/v3/users/86b3d5160cab4a51b3632fe8918f9b69 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:06.558946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:06.560395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:06.577249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bb8b0-08df-4cfe-b648-e0aeeb625018 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:06.639372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:06.640022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.640304 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.640580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] PATH_INFO: `/v3/projects/107b0551864f423c9198f0d814a6026c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.641779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107b0551864f423c9198f0d814a6026c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:06.643840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:06.699800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107b0551864f423c9198f0d814a6026c', 'request_id': 'req-64740f19-e95b-4ff0-868d-5d6158009d72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.707773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107b0551864f423c9198f0d814a6026c', 'request_id': 'req-64740f19-e95b-4ff0-868d-5d6158009d72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.714615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107b0551864f423c9198f0d814a6026c', 'request_id': 'req-64740f19-e95b-4ff0-868d-5d6158009d72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.725995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] The token cache is being invalidate because project 107b0551864f423c9198f0d814a6026c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:06.726294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.726988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-64740f19-e95b-4ff0-868d-5d6158009d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:06.728512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1054/2137] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:06 2022] DELETE /identity/v3/projects/107b0551864f423c9198f0d814a6026c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:06.734365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.734658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.734958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.767671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:06.769096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:06.836287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1084/2138] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:06.844150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.844441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.844735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.870363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:06.871577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:06.880214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1055/2139] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:06.885128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:06.895151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a3e0d-aa7c-465b-bd30-c9b7ad617c1c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:06.900369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:06.901009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.901325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.901745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.902410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:24:06.902717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:06.904336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:06.917220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1085/2140] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:24:06.922042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:06.935632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bed815-8dbd-4e80-b03c-11d4da1859de None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:06.940314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:06.940980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:06.941622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:06.941924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:06.942677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:06.944799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:06.972930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1056/2141] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:06 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:06.978361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:06.988760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68151ea-73f5-439a-bd28-a053f07b702d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.048324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.049045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.049468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.049767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.050410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.052427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.074270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1086/2142] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:06 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:07.078788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.090578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adec64-4238-41ce-b0dd-470778e8dce8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.103498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.104229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.105251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.105597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.106324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.108002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.109809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:07.120806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1057/2143] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:07.124706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.136015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4b06-e0b0-456d-8507-07678321823e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.140665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4ece2-88a5-4a26-ba89-c1112e60977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.141402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ece2-88a5-4a26-ba89-c1112e60977a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.141680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ece2-88a5-4a26-ba89-c1112e60977a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.141951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4ece2-88a5-4a26-ba89-c1112e60977a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.142590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4ece2-88a5-4a26-ba89-c1112e60977a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.144370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4ece2-88a5-4a26-ba89-c1112e60977a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.157593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1087/2144] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:07.161812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.172777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0766f48-c3b8-4315-b206-e0fe8822bac9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.177393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.178039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.178986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.179258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] PATH_INFO: `/v3/projects/d93e1a4e1d8c478e966e00c2c0a99d78/users/d8a3268e387947d0935bc43e7c9fb33a/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.200106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93e1a4e1d8c478e966e00c2c0a99d78, user_id=d8a3268e387947d0935bc43e7c9fb33a, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.205396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.224418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1058/2145] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:07 2022] PUT /identity/v3/projects/d93e1a4e1d8c478e966e00c2c0a99d78/users/d8a3268e387947d0935bc43e7c9fb33a/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:07.236091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.236659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.236840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.266270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] MFA Rules not processed for user `d8a3268e387947d0935bc43e7c9fb33a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:07.267478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:07.302597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:07.336416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1088/2146] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:07.341167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.403131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f33ac8-1e33-4ffb-89d7-7094d5759b6e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.407906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.408635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.408912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.409213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.410110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.414002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.441327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1059/2147] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:07 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:07.450205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.462115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e018-8fbd-4052-80a0-9ee5d403f1e5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.519846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.520562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.520858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.521139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.521845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.524009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.544289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1089/2148] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:07 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:24:07.548345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.558980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b2cb-e57e-49a7-bd62-eada552e9484 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.564611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.565299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.565603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.565923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.566645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.568307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.582103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1060/2149] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:07.586422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.597488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d53729-6c8a-4322-bf8b-05a4153d242d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.602692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.603355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.603637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.603915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] PATH_INFO: `/v3/projects/657a070d62154c739dae669d0c85629d/users/a6f8fd8c45fe43e6ab5b7a3f32a716bf/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.618693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657a070d62154c739dae669d0c85629d, user_id=a6f8fd8c45fe43e6ab5b7a3f32a716bf, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.621377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.635321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1090/2150] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:07 2022] PUT /identity/v3/projects/657a070d62154c739dae669d0c85629d/users/a6f8fd8c45fe43e6ab5b7a3f32a716bf/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:07.639324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.650569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e49c38-1495-4f19-b90b-af405e88ac51 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.709438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3007fb-caee-46a7-b4d5-74b06663dd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.710749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3007fb-caee-46a7-b4d5-74b06663dd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.711190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3007fb-caee-46a7-b4d5-74b06663dd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.711472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3007fb-caee-46a7-b4d5-74b06663dd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.712131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3007fb-caee-46a7-b4d5-74b06663dd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.713864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3007fb-caee-46a7-b4d5-74b06663dd1e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.726274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1061/2151] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:07.730580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.741419 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41b840-ca6d-4a37-9f2d-beb3ef23d406 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:07.747918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:07.748616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.748974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.749299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] PATH_INFO: `/v3/projects/657a070d62154c739dae669d0c85629d/users/a6f8fd8c45fe43e6ab5b7a3f32a716bf/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.754034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=657a070d62154c739dae669d0c85629d, user_id=a6f8fd8c45fe43e6ab5b7a3f32a716bf, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:07.757287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:07.771676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1091/2152] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:07 2022] PUT /identity/v3/projects/657a070d62154c739dae669d0c85629d/users/a6f8fd8c45fe43e6ab5b7a3f32a716bf/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:07.782477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:07.782836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:07.783187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:07.820005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] MFA Rules not processed for user `a6f8fd8c45fe43e6ab5b7a3f32a716bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:07.821344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:07.859334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:07.929328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1062/2153] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:07.936093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:07.938262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:08.032763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab0b82-2c2b-4f4b-84d7-80d22cb3aab0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:08.037965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85601297-43e3-4e1e-9ee4-92689ecb7658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:08.038613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601297-43e3-4e1e-9ee4-92689ecb7658 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:08.038892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601297-43e3-4e1e-9ee4-92689ecb7658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:08.039165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85601297-43e3-4e1e-9ee4-92689ecb7658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:08.103636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:08.126014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85601297-43e3-4e1e-9ee4-92689ecb7658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:08.127812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85601297-43e3-4e1e-9ee4-92689ecb7658 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:08.140528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1092/2154] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:10.778888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:10.846330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e642f87-9080-4406-8d32-3d3e5bdc01f8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:10.851056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:10.851702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:10.851987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:10.852265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] PATH_INFO: `/v3/users/d8a3268e387947d0935bc43e7c9fb33a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:10.853474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a3268e387947d0935bc43e7c9fb33a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:10.855429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:10.906817 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a3268e387947d0935bc43e7c9fb33a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:10.907487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a3268e387947d0935bc43e7c9fb33a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:10.916435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a3268e387947d0935bc43e7c9fb33a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:10.929837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a3268e387947d0935bc43e7c9fb33a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:10.930717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a3268e387947d0935bc43e7c9fb33a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:10.947995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1063/2155] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:10 2022] DELETE /identity/v3/users/d8a3268e387947d0935bc43e7c9fb33a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:10.952501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:10.952992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:10.953534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:10.981284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:10.983748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:11.057740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1093/2156] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:11.065585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:11.070099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:11.192575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:11.198839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c494ab6-67c4-4381-99d6-2d198a9b4a5f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:11.203705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b74744-7819-42a2-95a9-94dfc37c318d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:11.204846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b74744-7819-42a2-95a9-94dfc37c318d service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:11.205315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b74744-7819-42a2-95a9-94dfc37c318d service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:11.205736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b74744-7819-42a2-95a9-94dfc37c318d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:11.220708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b74744-7819-42a2-95a9-94dfc37c318d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:11.222607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b74744-7819-42a2-95a9-94dfc37c318d service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:11.237906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1064/2157] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:11.544990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:11.546475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:11.561132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219400d-2fd4-40aa-aa68-22379c63811b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:11.565047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:11.565724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:11.566006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:11.566280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] PATH_INFO: `/v3/projects/d93e1a4e1d8c478e966e00c2c0a99d78` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:11.567415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93e1a4e1d8c478e966e00c2c0a99d78)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:11.569459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:11.604578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:11.604859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:11.605156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:11.626852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] MFA Rules not processed for user `ec44cffca8074325ba224907d37c2a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:11.628051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:11.638474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93e1a4e1d8c478e966e00c2c0a99d78', 'request_id': 'req-8c36baaf-f71b-48a3-84c7-5f5c1d650925'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.645090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93e1a4e1d8c478e966e00c2c0a99d78', 'request_id': 'req-8c36baaf-f71b-48a3-84c7-5f5c1d650925'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.654059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93e1a4e1d8c478e966e00c2c0a99d78', 'request_id': 'req-8c36baaf-f71b-48a3-84c7-5f5c1d650925'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.666063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] The token cache is being invalidate because project d93e1a4e1d8c478e966e00c2c0a99d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:11.666447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.667150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.668703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1094/2158] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:11 2022] DELETE /identity/v3/projects/d93e1a4e1d8c478e966e00c2c0a99d78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:11.673141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:11.674894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:11.686834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1065/2159] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:11.752093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36baaf-f71b-48a3-84c7-5f5c1d650925 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:11.757785 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:11.761255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:11.761827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:11.762348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] PATH_INFO: `/v3/users/a6f8fd8c45fe43e6ab5b7a3f32a716bf` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:11.763916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f8fd8c45fe43e6ab5b7a3f32a716bf)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:11.766430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:11.773557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:11.818299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f8fd8c45fe43e6ab5b7a3f32a716bf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.819109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f8fd8c45fe43e6ab5b7a3f32a716bf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.826452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f8fd8c45fe43e6ab5b7a3f32a716bf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.834102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f8fd8c45fe43e6ab5b7a3f32a716bf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.835321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-446e8332-8971-4a7f-a5a6-42ea6adc3cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f8fd8c45fe43e6ab5b7a3f32a716bf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:11.857331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1095/2160] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:11 2022] DELETE /identity/v3/users/a6f8fd8c45fe43e6ab5b7a3f32a716bf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:24:12.148538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.161923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d63c5-43b3-4b27-97d4-b5264366f079 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:12.245892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:12.246711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.247200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.247597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] PATH_INFO: `/v3/projects/657a070d62154c739dae669d0c85629d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.248941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657a070d62154c739dae669d0c85629d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:12.259835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:12.343731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657a070d62154c739dae669d0c85629d', 'request_id': 'req-603f9de1-3a3e-4912-9c95-bbad4d982a32'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:12.365070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657a070d62154c739dae669d0c85629d', 'request_id': 'req-603f9de1-3a3e-4912-9c95-bbad4d982a32'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:12.373155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657a070d62154c739dae669d0c85629d', 'request_id': 'req-603f9de1-3a3e-4912-9c95-bbad4d982a32'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:12.390664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] The token cache is being invalidate because project 657a070d62154c739dae669d0c85629d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:12.390823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:12.391512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-603f9de1-3a3e-4912-9c95-bbad4d982a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:12.404500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.404986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.405080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.408489 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1066/2161] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:12 2022] DELETE /identity/v3/projects/657a070d62154c739dae669d0c85629d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:12.437653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:12.440065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:12.519536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1096/2162] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:12.527941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.528955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.528955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.559007 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:12.560210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:12.580104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1067/2163] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:12.585580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.598938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8947c9e-8338-482c-80cd-5846f09092f7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:12.609491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:12.610115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.611215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.611215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.612007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:24:12.612342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:12.614286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:12.644289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1097/2164] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:24:12.647201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.668464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506628c4-3497-44fa-9db7-c596b1abe6ba None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:12.683181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:12.683807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.684085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.684355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.685002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:12.687121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:12.739316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:12.758937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.759088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1068/2165] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:12 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:12.770821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5584c1-ef8e-4aff-a0f5-1c32d3284173 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:12.855901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:12.856692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.857011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.857308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.857964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:12.859884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:12.885159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1098/2166] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:12 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:12.887344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.899108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac904e7e-5f84-42bf-90e2-bd283a435204 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:12.905002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:12.905653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.905931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.906207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.906847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:12.908510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:12.922055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1069/2167] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:12.926376 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.934454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:12.940370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d306af-b7a5-4e87-ae9b-4d3d8b431cb6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:12.947265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe6258-998b-4a83-b9f5-06a8e59c1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:12.948040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe6258-998b-4a83-b9f5-06a8e59c1d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:12.948503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe6258-998b-4a83-b9f5-06a8e59c1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:12.949131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe6258-998b-4a83-b9f5-06a8e59c1d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:12.950006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe6258-998b-4a83-b9f5-06a8e59c1d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:12.951823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe6258-998b-4a83-b9f5-06a8e59c1d01 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:12.967543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1099/2168] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:12.971380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:12.982831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d84a-2342-4f9c-810a-c5f543083e6d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:13.001941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:13.002786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:13.003133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:13.003656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] PATH_INFO: `/v3/projects/5b71fe798e9b47c4b089bf7a68f82559/users/9930a95ad33d4cf7b96d64700e53edad/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:13.022102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b71fe798e9b47c4b089bf7a68f82559, user_id=9930a95ad33d4cf7b96d64700e53edad, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:13.024829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:13.044154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1070/2169] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:12 2022] PUT /identity/v3/projects/5b71fe798e9b47c4b089bf7a68f82559/users/9930a95ad33d4cf7b96d64700e53edad/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:13.056144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:13.056432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:13.056710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:13.095357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] MFA Rules not processed for user `9930a95ad33d4cf7b96d64700e53edad`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:13.096724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:13.178352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1100/2170] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:13.192297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:13.195095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:13.259134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee8cf-42ae-4539-9f89-9f8b6f66e732 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:13.263089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce90f8-7aeb-4107-9d5c-edb84a315311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:13.263885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce90f8-7aeb-4107-9d5c-edb84a315311 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:13.264491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce90f8-7aeb-4107-9d5c-edb84a315311 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:13.264960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce90f8-7aeb-4107-9d5c-edb84a315311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:13.275405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce90f8-7aeb-4107-9d5c-edb84a315311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:13.276814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce90f8-7aeb-4107-9d5c-edb84a315311 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:13.286071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1071/2171] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:16.490317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:16.552418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393ce2-e6bf-4058-a5af-463288517b7d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:16.557330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:16.557973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:16.558255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:16.558532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] PATH_INFO: `/v3/users/9930a95ad33d4cf7b96d64700e53edad` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:16.559647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9930a95ad33d4cf7b96d64700e53edad)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:16.561615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:16.610599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9930a95ad33d4cf7b96d64700e53edad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:16.611258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9930a95ad33d4cf7b96d64700e53edad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:16.618340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9930a95ad33d4cf7b96d64700e53edad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:16.626301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9930a95ad33d4cf7b96d64700e53edad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:16.626986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9930a95ad33d4cf7b96d64700e53edad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:16.641434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:16.646369 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1101/2172] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:16 2022] DELETE /identity/v3/users/9930a95ad33d4cf7b96d64700e53edad => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:16.651544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:16.652065 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:16.652168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:16.672150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:16.673394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:16.733942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1072/2173] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:16.744375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:16.746265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:16.804703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3f88-2363-408a-a1db-1da4e48e1abd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:16.809198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ccf22-43e4-4e4e-99f5-922bd8173a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:16.810028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ccf22-43e4-4e4e-99f5-922bd8173a91 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:16.810320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ccf22-43e4-4e4e-99f5-922bd8173a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:16.810598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ccf22-43e4-4e4e-99f5-922bd8173a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:16.821945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ccf22-43e4-4e4e-99f5-922bd8173a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:16.823544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ccf22-43e4-4e4e-99f5-922bd8173a91 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:16.835504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1102/2174] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:17.154732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.156365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:17.170223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba64f6-a0ef-4627-9fb6-fd71e64ee65a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.175401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.176037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.176317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.176592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] PATH_INFO: `/v3/projects/5b71fe798e9b47c4b089bf7a68f82559` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.177839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b71fe798e9b47c4b089bf7a68f82559)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.180592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.231203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b71fe798e9b47c4b089bf7a68f82559', 'request_id': 'req-fb50e34f-ce33-4c37-8215-00cf86793a7b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:17.239187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b71fe798e9b47c4b089bf7a68f82559', 'request_id': 'req-fb50e34f-ce33-4c37-8215-00cf86793a7b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:17.241911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:17.247471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b71fe798e9b47c4b089bf7a68f82559', 'request_id': 'req-fb50e34f-ce33-4c37-8215-00cf86793a7b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:17.261207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] The token cache is being invalidate because project 5b71fe798e9b47c4b089bf7a68f82559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:17.261533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:17.262234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fb50e34f-ce33-4c37-8215-00cf86793a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:17.263863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1073/2175] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:17 2022] DELETE /identity/v3/projects/5b71fe798e9b47c4b089bf7a68f82559 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:17.270955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.271245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.271518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.292544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:17.293874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:17.361438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1103/2176] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:17.370132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.370427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.370860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.391316 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:17.392514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:17.401129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1074/2177] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:17.405845 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.416319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80407bb9-1690-4a76-b580-8c26b9798b26 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.421533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.422164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.422470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.422746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.423467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:24:17.423837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.425566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.438677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1104/2178] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:24:17.443110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.454119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162d74c-f821-47fb-b7b5-6410e0380529 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.459009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.459911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.460397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.460839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.461598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.463619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.496110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1075/2179] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:17 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:24:17.500373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.510526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b49ded-c1fb-4f5b-a0cc-50fa1755b713 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.570673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.571281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.571556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.571825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.572466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.574415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.595838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1105/2180] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:17 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:17.599832 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.610794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6e6f-ce0b-441d-9514-5697a199f466 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.615700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.616606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.616938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.617393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.620096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.620296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.631825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1076/2181] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:17.635753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.645838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a365c-2daf-4f6e-adb6-5ade5f30e2dd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.651525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d2f24-c1d5-4883-a1ce-3f5db200b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.652124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2f24-c1d5-4883-a1ce-3f5db200b461 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.652414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2f24-c1d5-4883-a1ce-3f5db200b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.652692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d2f24-c1d5-4883-a1ce-3f5db200b461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.653368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d2f24-c1d5-4883-a1ce-3f5db200b461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.654974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d2f24-c1d5-4883-a1ce-3f5db200b461 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.665191 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1106/2182] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:17.669526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.681365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2459538-f271-4ec3-94f4-2d86512a8c32 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.686040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.686697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.687002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.687275 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] PATH_INFO: `/v3/projects/838c3f1cf82149509b826d6127ec806c/users/00a99694a63747d9ac3a08724584fe73/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.702423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] RBAC: Authorizing `identity:create_grant(project_id=838c3f1cf82149509b826d6127ec806c, user_id=00a99694a63747d9ac3a08724584fe73, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.705042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.721355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1077/2183] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:17 2022] PUT /identity/v3/projects/838c3f1cf82149509b826d6127ec806c/users/00a99694a63747d9ac3a08724584fe73/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:17.731696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca092cb5-ae22-483c-a65b-a3941d4a6b4a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.731983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca092cb5-ae22-483c-a65b-a3941d4a6b4a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.732261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca092cb5-ae22-483c-a65b-a3941d4a6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.755742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:17.766640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ca092cb5-ae22-483c-a65b-a3941d4a6b4a None None] MFA Rules not processed for user `00a99694a63747d9ac3a08724584fe73`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:17.768559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ca092cb5-ae22-483c-a65b-a3941d4a6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:17.838772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1107/2184] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:17.850286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:17.852159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:17.913643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90518e-0325-48e4-a524-ca433a3eaeee admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:17.917418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17a19d-4960-445d-b511-06e711af6c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:17.918042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a19d-4960-445d-b511-06e711af6c51 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:17.918323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a19d-4960-445d-b511-06e711af6c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:17.918598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17a19d-4960-445d-b511-06e711af6c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:17.927533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17a19d-4960-445d-b511-06e711af6c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:17.929592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17a19d-4960-445d-b511-06e711af6c51 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:17.938460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1078/2185] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:18.816896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59796513-44bf-48ff-9615-406877ef60fb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:18.817421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59796513-44bf-48ff-9615-406877ef60fb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:18.817560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59796513-44bf-48ff-9615-406877ef60fb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:18.819689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1108/2186] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:24:18.824709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:18.825152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:18.825318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:18.847952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:18.849250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:18.917192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1079/2187] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:24:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:18.941568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59796513-44bf-48ff-9615-406877ef60fb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:18.945777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59796513-44bf-48ff-9615-406877ef60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:18.962337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59796513-44bf-48ff-9615-406877ef60fb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:18.967960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:18.968542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:18.968866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:18.969227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:18.979888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:18.981579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:18.994140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1109/2188] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:19.746990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:19.748552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:19.776244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:19.816207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67457209-8a79-4571-8fb8-56efc99916a1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:19.821513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:19.822139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:19.822497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:19.822776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] PATH_INFO: `/v3/users/227e457382a04d19bc3c967e1d3d2a33` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:19.823899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227e457382a04d19bc3c967e1d3d2a33)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:19.825898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:19.883503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227e457382a04d19bc3c967e1d3d2a33'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:19.884307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227e457382a04d19bc3c967e1d3d2a33'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:19.893789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227e457382a04d19bc3c967e1d3d2a33'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:19.907018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227e457382a04d19bc3c967e1d3d2a33'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:19.907696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227e457382a04d19bc3c967e1d3d2a33'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:19.923797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1080/2189] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:19 2022] DELETE /identity/v3/users/227e457382a04d19bc3c967e1d3d2a33 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:20.105061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:20.116486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46291-7554-4fe7-a4f4-afff2d37f87d service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:20.178474 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:20.179137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.179420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.179693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] PATH_INFO: `/v3/projects/1e33df386d8648b68d4a347a2d8c5636` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.180834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e33df386d8648b68d4a347a2d8c5636)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:20.182775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:20.237282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e33df386d8648b68d4a347a2d8c5636', 'request_id': 'req-a08850c5-95f8-4205-a1fd-83c5405ed0a8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.244542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e33df386d8648b68d4a347a2d8c5636', 'request_id': 'req-a08850c5-95f8-4205-a1fd-83c5405ed0a8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.252669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e33df386d8648b68d4a347a2d8c5636', 'request_id': 'req-a08850c5-95f8-4205-a1fd-83c5405ed0a8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.264211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] The token cache is being invalidate because project 1e33df386d8648b68d4a347a2d8c5636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:20.264505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.265186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.266686 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1110/2190] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:20 2022] DELETE /identity/v3/projects/1e33df386d8648b68d4a347a2d8c5636 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:20.270891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:20.273307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:20.289553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2a94f-12b0-4d86-8fcf-a899070a8a43 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:20.347936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:20.348480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.348754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.349023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] PATH_INFO: `/v3/users/72cbe87975be4c72ad2208409b1ddf5c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.350844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cbe87975be4c72ad2208409b1ddf5c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:20.352748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:20.398422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:20.401356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cbe87975be4c72ad2208409b1ddf5c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.402390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cbe87975be4c72ad2208409b1ddf5c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.410358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cbe87975be4c72ad2208409b1ddf5c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.422888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cbe87975be4c72ad2208409b1ddf5c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.423535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cbe87975be4c72ad2208409b1ddf5c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.436369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1081/2191] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:20 2022] DELETE /identity/v3/users/72cbe87975be4c72ad2208409b1ddf5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:24:20.612893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:20.614398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:20.634150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08850c5-95f8-4205-a1fd-83c5405ed0a8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:20.646201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:20.672840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:20.674272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:20.700848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:20.701550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.701831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.702107 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] PATH_INFO: `/v3/projects/6147d122e5514ff9906ed6a8d5921131` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.703219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6147d122e5514ff9906ed6a8d5921131)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:20.705147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:20.752295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3c4ee-6f0b-49c7-88ad-6c457f731565 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:20.769916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6147d122e5514ff9906ed6a8d5921131', 'request_id': 'req-a7a7f5df-437a-425f-b467-6cb2cea4aac7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.778430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6147d122e5514ff9906ed6a8d5921131', 'request_id': 'req-a7a7f5df-437a-425f-b467-6cb2cea4aac7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.791306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6147d122e5514ff9906ed6a8d5921131', 'request_id': 'req-a7a7f5df-437a-425f-b467-6cb2cea4aac7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.806182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] The token cache is being invalidate because project 6147d122e5514ff9906ed6a8d5921131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:20.806801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.807522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7a7f5df-437a-425f-b467-6cb2cea4aac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.809414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1111/2192] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:20 2022] DELETE /identity/v3/projects/6147d122e5514ff9906ed6a8d5921131 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:20.814835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320fb1-fea9-40d6-ad6a-d6c62c9931d1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.815124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320fb1-fea9-40d6-ad6a-d6c62c9931d1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.815405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a320fb1-fea9-40d6-ad6a-d6c62c9931d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.825799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:20.826619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.827200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.827294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] PATH_INFO: `/v3/users/00a99694a63747d9ac3a08724584fe73` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.828781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a99694a63747d9ac3a08724584fe73)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:20.832530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:20.837503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2a320fb1-fea9-40d6-ad6a-d6c62c9931d1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:20.838820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2a320fb1-fea9-40d6-ad6a-d6c62c9931d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:20.848206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1112/2193] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:20.857524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eca59-a99b-485b-bc1b-476be802754a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.857723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eca59-a99b-485b-bc1b-476be802754a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.857999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eca59-a99b-485b-bc1b-476be802754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.882256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-870eca59-a99b-485b-bc1b-476be802754a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:20.883491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-870eca59-a99b-485b-bc1b-476be802754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:20.897801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1113/2194] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:20.898917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eca59-a99b-485b-bc1b-476be802754a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:20.900418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a99694a63747d9ac3a08724584fe73'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.901224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a99694a63747d9ac3a08724584fe73'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.909587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eca59-a99b-485b-bc1b-476be802754a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:20.911332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a99694a63747d9ac3a08724584fe73'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.915065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:20.915732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.916019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.916298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.916955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:24:20.917380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:20.918998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:20.929718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:20.930819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a99694a63747d9ac3a08724584fe73'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.934899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1114/2195] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:24:20.935052 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06861b1d-8c10-43b5-9952-6444af5cd5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a99694a63747d9ac3a08724584fe73'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:20.935997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:20.938400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:20.949198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1082/2196] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:20 2022] DELETE /identity/v3/users/00a99694a63747d9ac3a08724584fe73 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:24:20.952812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:20.953099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:20.953404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:20.958401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eaac5-0702-4721-8c60-373aedf47fe2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:20.982531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:20.983854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.029820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.030551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.030717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.030991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.031622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.033628 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.067438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1083/2197] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:21.075190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.077247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1115/2198] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:20 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:21.078215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.081089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.093054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:21.148296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afe8ef-84b4-448c-9454-087ae81784b1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.162579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084eeab-c88a-4768-8b1d-f6915205bef4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.168977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.169730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.170747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.171108 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.171835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.174400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.205955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1116/2199] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:21 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:21.210655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.211690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.212369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.212723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.213002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.225174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.225407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15783e31-2a95-45fb-8d9e-2004ea6cc8d0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.225496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.230966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.231615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.231899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.232175 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.232828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.234471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.235878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1084/2200] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:21.250832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1117/2201] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:24:21.252102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.262745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6feb4-eac3-4302-a84a-1fa0037b1ad0 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.270311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e60605-47ac-40f6-a325-3d6414f5d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.271055 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e60605-47ac-40f6-a325-3d6414f5d780 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.271408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e60605-47ac-40f6-a325-3d6414f5d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.272288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e60605-47ac-40f6-a325-3d6414f5d780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.273237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e60605-47ac-40f6-a325-3d6414f5d780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.275049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e60605-47ac-40f6-a325-3d6414f5d780 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.292083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1085/2202] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:21.293529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.305718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49344a2e-bb39-41a8-bc44-1836d9e61de2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.310554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.311240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.311520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.311800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] PATH_INFO: `/v3/projects/5647fc01664b446fba5cc62f211f14c9/users/e148fb988b684352894a775c3c784e0b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.333527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5647fc01664b446fba5cc62f211f14c9, user_id=e148fb988b684352894a775c3c784e0b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.337598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.354938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1118/2203] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:21 2022] PUT /identity/v3/projects/5647fc01664b446fba5cc62f211f14c9/users/e148fb988b684352894a775c3c784e0b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:21.366076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.367224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.368004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.404123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] MFA Rules not processed for user `e148fb988b684352894a775c3c784e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:21.405846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.438267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:21.487047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1086/2204] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:21.503967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.505851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.565699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.567208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.650368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5935f-a2b1-4a3b-a6f4-1ee390bde9c2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.654316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94495bb6-e3bb-402a-b1c1-65fd8edb5250 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.655290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94495bb6-e3bb-402a-b1c1-65fd8edb5250 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.655581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94495bb6-e3bb-402a-b1c1-65fd8edb5250 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.656048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94495bb6-e3bb-402a-b1c1-65fd8edb5250 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.666101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94495bb6-e3bb-402a-b1c1-65fd8edb5250 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.667590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94495bb6-e3bb-402a-b1c1-65fd8edb5250 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.678773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1119/2205] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:21.680573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b15251-33e3-4217-a5d9-1836aae22253 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.686545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.687197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.687477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.687755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] PATH_INFO: `/v3/projects/838c3f1cf82149509b826d6127ec806c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.689033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838c3f1cf82149509b826d6127ec806c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.690880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.746010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838c3f1cf82149509b826d6127ec806c', 'request_id': 'req-e804c553-c0b3-48fa-8956-e67bb35ffcf0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:21.762592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838c3f1cf82149509b826d6127ec806c', 'request_id': 'req-e804c553-c0b3-48fa-8956-e67bb35ffcf0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:21.771106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838c3f1cf82149509b826d6127ec806c', 'request_id': 'req-e804c553-c0b3-48fa-8956-e67bb35ffcf0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:21.784429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] The token cache is being invalidate because project 838c3f1cf82149509b826d6127ec806c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:21.784841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:21.786188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e804c553-c0b3-48fa-8956-e67bb35ffcf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:21.788869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1087/2206] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:21 2022] DELETE /identity/v3/projects/838c3f1cf82149509b826d6127ec806c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:24:21.793781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.794074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.794352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.815702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:21.816937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.866961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:21.893856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1120/2207] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:21.903244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.903720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.903873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.925918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:21.927338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:21.938291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1088/2208] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:21.942588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.952452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa23a99-dcae-4987-87ac-923743c82058 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.957099 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.957719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.957998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.958378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.959032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:24:21.960000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:21.961972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:21.974514 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1121/2209] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:24:21.980195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:21.989724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a784a-ea76-4171-8c20-d32967d61a40 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:21.995906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:21.996613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:21.997587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:21.997587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:21.998214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:22.000233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:22.029663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1089/2210] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:21 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:22.033861 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:22.046036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3c085-fa05-4b27-8ed4-c1f4bbe1f13e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:22.121983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:22.122760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:22.123162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:22.123917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:22.124302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:22.126491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:22.151422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1122/2211] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:22 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:22.155938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:22.169187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a837a-f805-48e3-8671-d7186f6e964f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:22.178710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:22.179484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:22.179800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:22.180076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:22.180728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:22.183001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:22.198895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1090/2212] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:22.200441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:22.225990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b3e9e-926e-4bbd-8c42-9c6eb48aa1e5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:22.225990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f2a7-c980-4568-9f32-98b726875e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:22.225990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f2a7-c980-4568-9f32-98b726875e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:22.225990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f2a7-c980-4568-9f32-98b726875e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:22.226616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f2a7-c980-4568-9f32-98b726875e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:22.227367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f2a7-c980-4568-9f32-98b726875e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:22.229102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f2a7-c980-4568-9f32-98b726875e5d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:22.245627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1123/2213] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:22.249910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:22.265145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ba196-71ff-4a75-bb5e-9371862578e0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:22.274277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:22.275554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:22.275934 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:22.276309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] PATH_INFO: `/v3/projects/d39674329e3b40d0ade90aef9914497d/users/7909e27d955146fcb172cb3ff199853d/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:22.296641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:22.300165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39674329e3b40d0ade90aef9914497d, user_id=7909e27d955146fcb172cb3ff199853d, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:22.303607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:22.320826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1091/2214] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:22 2022] PUT /identity/v3/projects/d39674329e3b40d0ade90aef9914497d/users/7909e27d955146fcb172cb3ff199853d/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:22.326696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd34af-f949-49b3-9fb5-32daa84c0138 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:22.327541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd34af-f949-49b3-9fb5-32daa84c0138 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:22.328326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd34af-f949-49b3-9fb5-32daa84c0138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:22.351575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f2dd34af-f949-49b3-9fb5-32daa84c0138 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:22.353058 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f2dd34af-f949-49b3-9fb5-32daa84c0138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:22.421646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1124/2215] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:22.431757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:22.433493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:22.491854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b981980-ac0f-4143-bf7b-449f98d242c7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:22.495552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:22.496158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:22.496456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:22.496735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:22.506608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:22.508210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:22.518685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1092/2216] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:23.180893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718ea5-7a3f-4558-a564-582eb63a87ae None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:23.181252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718ea5-7a3f-4558-a564-582eb63a87ae None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:23.181541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718ea5-7a3f-4558-a564-582eb63a87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:23.214726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7b718ea5-7a3f-4558-a564-582eb63a87ae None None] MFA Rules not processed for user `7909e27d955146fcb172cb3ff199853d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:23.216654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b718ea5-7a3f-4558-a564-582eb63a87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:23.281482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:23.315005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1125/2217] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:23.326701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:23.328350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:23.404722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70619f2-c630-4681-92d3-e8a634961874 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:23.411989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a314eb-3c36-45fe-ac38-bd3651a17a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:23.411989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a314eb-3c36-45fe-ac38-bd3651a17a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:23.411989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a314eb-3c36-45fe-ac38-bd3651a17a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:23.411989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a314eb-3c36-45fe-ac38-bd3651a17a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:23.424240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a314eb-3c36-45fe-ac38-bd3651a17a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:23.427140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a314eb-3c36-45fe-ac38-bd3651a17a14 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:23.439093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1093/2218] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:24.874444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:24.875055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:24.875330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:24.895692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] MFA Rules not processed for user `7909e27d955146fcb172cb3ff199853d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:24.896986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:24.904120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1126/2219] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:33.445820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:34.890331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=13 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:36.753353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:36.753815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:36.754137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:36.781274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:36.782826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:36.876862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1094/2220] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:24:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:36.938046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:36.939661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:37.024471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9821dc-15c4-49ed-91a8-28851313c30a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:37.030525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a393794-5549-4460-8c1e-62e99382df04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:37.031150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a393794-5549-4460-8c1e-62e99382df04 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:37.031430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a393794-5549-4460-8c1e-62e99382df04 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:37.032270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a393794-5549-4460-8c1e-62e99382df04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:37.048966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a393794-5549-4460-8c1e-62e99382df04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:37.051136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a393794-5549-4460-8c1e-62e99382df04 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:37.060235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1127/2221] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:24:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:24:40.219357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:40.220776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:40.236230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb23b9-dee8-4cce-9567-4d010e6152b6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:40.240854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:40.241528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:40.241833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:40.242124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] PATH_INFO: `/v3/users/af8b07440ec243969369b003c836f636` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:40.243253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8b07440ec243969369b003c836f636)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:40.245227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:40.300655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8b07440ec243969369b003c836f636'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:40.301690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8b07440ec243969369b003c836f636'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:40.311102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8b07440ec243969369b003c836f636'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:40.328910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8b07440ec243969369b003c836f636'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:40.329778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8b07440ec243969369b003c836f636'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:40.344041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1095/2222] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:40 2022] DELETE /identity/v3/users/af8b07440ec243969369b003c836f636 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:40.348596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:40.349089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:40.349230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:40.370140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:40.371414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:40.438703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1128/2223] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:40.452814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:40.455883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:40.519533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2a002-737e-46e4-8ddb-402c55f0ab88 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:40.527887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3eba-f9c7-4ad2-99d3-5af48e84f55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:40.528510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3eba-f9c7-4ad2-99d3-5af48e84f55a service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:40.528785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3eba-f9c7-4ad2-99d3-5af48e84f55a service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:40.529078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3eba-f9c7-4ad2-99d3-5af48e84f55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:40.539269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e3eba-f9c7-4ad2-99d3-5af48e84f55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:40.540950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e3eba-f9c7-4ad2-99d3-5af48e84f55a service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:40.569418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1096/2224] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:41.333919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.335804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:41.399622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ebf55-81b1-4f9a-a660-1942befea2c9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.409426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.411587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.412455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.412739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] PATH_INFO: `/v3/projects/2884aba72ca740a3ac59f38972f69c9e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.415332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2884aba72ca740a3ac59f38972f69c9e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:41.427542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:41.487597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2884aba72ca740a3ac59f38972f69c9e', 'request_id': 'req-e69882ea-edba-4b4e-ad7d-5cf254f66f75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:41.495677 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2884aba72ca740a3ac59f38972f69c9e', 'request_id': 'req-e69882ea-edba-4b4e-ad7d-5cf254f66f75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:41.503732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2884aba72ca740a3ac59f38972f69c9e', 'request_id': 'req-e69882ea-edba-4b4e-ad7d-5cf254f66f75'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:41.519074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] The token cache is being invalidate because project 2884aba72ca740a3ac59f38972f69c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:41.519276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:41.520473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69882ea-edba-4b4e-ad7d-5cf254f66f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:41.526877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1129/2225] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:41 2022] DELETE /identity/v3/projects/2884aba72ca740a3ac59f38972f69c9e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:41.528286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.529011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.529011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.550592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:41.551853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:41.571901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:41.663305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1097/2226] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:24:41.670884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.671192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.671487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.697636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:41.698903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:41.707575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1130/2227] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:41.712445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.722333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c8722-2304-42a7-b1f0-207e0ba9e7f1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.728587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.729245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.729532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.729807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.730466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:24:41.730777 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:41.733020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:41.748153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1098/2228] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:24:41.752307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.762730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec66c34-9817-4c05-9db6-7aa55f49e419 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.767382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.767978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.768253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.768535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.769239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:41.771148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:41.775695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:41.803508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1131/2229] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:24:41 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:41.808691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.819698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b09ff-b1a2-432e-a74c-3bf439d09b68 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.875071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.875667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.875946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.876219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.876835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:41.878793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:41.901937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1099/2230] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:24:41 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:24:41.906364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.918766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680cad0-0471-4dc5-86c4-ef2cb13a3f56 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.924199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.924797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.925076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.925395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.926028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:41.927618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:41.937491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1132/2231] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:24:41.941672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.952118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d57bb-57d7-49a3-8309-fba54809881d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.956730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255167c-8e6c-4ee0-8f4f-8bd032dcf6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.957346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255167c-8e6c-4ee0-8f4f-8bd032dcf6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.957630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255167c-8e6c-4ee0-8f4f-8bd032dcf6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.957906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255167c-8e6c-4ee0-8f4f-8bd032dcf6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:41.958582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255167c-8e6c-4ee0-8f4f-8bd032dcf6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:41.960883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255167c-8e6c-4ee0-8f4f-8bd032dcf6b9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:41.971285 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1100/2232] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:24:41.975424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:41.985206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9019fee-4e03-493c-a799-8806b71bac41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:41.989799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:41.990480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:41.990759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:41.991034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] PATH_INFO: `/v3/projects/3274de7f0d7645ca8d9275045878dd9d/users/901830456dd94d698e6793ab50d23434/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:42.005399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3274de7f0d7645ca8d9275045878dd9d, user_id=901830456dd94d698e6793ab50d23434, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:42.008597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:42.022395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1133/2233] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:24:41 2022] PUT /identity/v3/projects/3274de7f0d7645ca8d9275045878dd9d/users/901830456dd94d698e6793ab50d23434/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:24:42.032453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac3ae4-bd48-49be-b0ca-20ae40a26495 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:42.032739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac3ae4-bd48-49be-b0ca-20ae40a26495 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:42.033012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac3ae4-bd48-49be-b0ca-20ae40a26495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:42.061922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5fac3ae4-bd48-49be-b0ca-20ae40a26495 None None] MFA Rules not processed for user `901830456dd94d698e6793ab50d23434`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:42.063136 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5fac3ae4-bd48-49be-b0ca-20ae40a26495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:42.135295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1101/2234] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:42.147225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:42.149077 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:42.207394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed071db-af9d-42a6-93ef-d63be6f8f3b1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:42.211705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:42.212331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:42.212596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:42.212870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:42.221713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:42.223280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:42.234332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1134/2235] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:44.280639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951ea4-c5d1-4689-a7d0-0ad241afdeaa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:44.281543 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951ea4-c5d1-4689-a7d0-0ad241afdeaa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:44.281825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00951ea4-c5d1-4689-a7d0-0ad241afdeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:44.303182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-00951ea4-c5d1-4689-a7d0-0ad241afdeaa None None] MFA Rules not processed for user `642764a1a825436bb4912e33f2cb4135`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:44.304496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-00951ea4-c5d1-4689-a7d0-0ad241afdeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:44.314643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:44.369750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1102/2236] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:52.229517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:24:52.672484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:52.741674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bb8b9-f2ba-477d-8e43-4d424f985618 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:52.746232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:52.746909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:52.747136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:52.747411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] PATH_INFO: `/v3/users/901830456dd94d698e6793ab50d23434` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:52.748540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901830456dd94d698e6793ab50d23434)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:52.750564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:52.820336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901830456dd94d698e6793ab50d23434'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:52.821378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901830456dd94d698e6793ab50d23434'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:52.829169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901830456dd94d698e6793ab50d23434'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:52.840024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901830456dd94d698e6793ab50d23434'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:52.840643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901830456dd94d698e6793ab50d23434'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:52.864429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1135/2237] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:24:52 2022] DELETE /identity/v3/users/901830456dd94d698e6793ab50d23434 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:24:52.870073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:52.871273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:52.871736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:52.896716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:24:52.898465 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:52.972579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1103/2238] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:24:52.983062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:52.984594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:53.054640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23168d9d-ecfd-4ec1-b097-0176b7fe7980 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:53.058634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2c46-edae-45f5-844a-ee8eb51d21f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:53.059263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2c46-edae-45f5-844a-ee8eb51d21f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:53.059563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2c46-edae-45f5-844a-ee8eb51d21f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:53.059838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2c46-edae-45f5-844a-ee8eb51d21f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:53.069800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea2c46-edae-45f5-844a-ee8eb51d21f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:53.071271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea2c46-edae-45f5-844a-ee8eb51d21f6 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:53.082901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1136/2239] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:24:53.381247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:24:53.383060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:24:53.402436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c27ef9-07f2-4954-a2ce-34af41740211 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:24:53.408173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:24:53.409962 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:24:53.411789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:24:53.412334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] PATH_INFO: `/v3/projects/3274de7f0d7645ca8d9275045878dd9d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:24:53.414483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3274de7f0d7645ca8d9275045878dd9d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:24:53.416807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:24:53.492877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3274de7f0d7645ca8d9275045878dd9d', 'request_id': 'req-f862a7ee-2357-4537-9496-cb3e5405cfc3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:53.504000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3274de7f0d7645ca8d9275045878dd9d', 'request_id': 'req-f862a7ee-2357-4537-9496-cb3e5405cfc3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:53.519147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3274de7f0d7645ca8d9275045878dd9d', 'request_id': 'req-f862a7ee-2357-4537-9496-cb3e5405cfc3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:53.539267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] The token cache is being invalidate because project 3274de7f0d7645ca8d9275045878dd9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:24:53.540579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:53.541492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f862a7ee-2357-4537-9496-cb3e5405cfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:24:53.553678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1104/2240] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:24:53 2022] DELETE /identity/v3/projects/3274de7f0d7645ca8d9275045878dd9d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:25:00.876923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:00.877487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:00.877487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:00.898214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] MFA Rules not processed for user `4cc14630ede646698bb19f803e9952ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:00.899723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:00.917359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:00.964269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1137/2241] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:25:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:03.532399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:10.955988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=15 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:21.356199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:21.356746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:21.356746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:21.376459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:21.377718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:21.434895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1105/2242] 10.222.0.88 () {58 vars in 967 bytes} [Mon Aug 29 23:25:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:21.448646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:21.450205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:21.523105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe83a50-61f5-4091-9933-260bd2b19e07 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:21.528401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:21.529012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:21.529314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:21.529584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:21.538041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:21.539657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:21.547494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1138/2243] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:25:23.916401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:23.917964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:23.986747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c065-ddad-4f44-b370-bc5bba62488d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:23.992262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:23.993067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:23.993582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:23.993701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] PATH_INFO: `/v3/users/ec44cffca8074325ba224907d37c2a68` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:23.994852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec44cffca8074325ba224907d37c2a68)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:23.996775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:24.063145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec44cffca8074325ba224907d37c2a68'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.064622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec44cffca8074325ba224907d37c2a68'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.074645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec44cffca8074325ba224907d37c2a68'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.088752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec44cffca8074325ba224907d37c2a68'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.089928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec44cffca8074325ba224907d37c2a68'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.105585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1106/2244] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:25:23 2022] DELETE /identity/v3/users/ec44cffca8074325ba224907d37c2a68 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:25:24.300511 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:24.311387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2e09-9f81-4731-a054-4f548037b0b5 service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:24.378081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:24.378708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:24.378985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:24.379256 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] PATH_INFO: `/v3/projects/1f0ec128e46641349d903c625157c907` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:24.380926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0ec128e46641349d903c625157c907)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:24.382896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:24.431490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0ec128e46641349d903c625157c907', 'request_id': 'req-20736efb-8d14-462d-92da-83649389a232'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.437533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0ec128e46641349d903c625157c907', 'request_id': 'req-20736efb-8d14-462d-92da-83649389a232'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.445960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0ec128e46641349d903c625157c907', 'request_id': 'req-20736efb-8d14-462d-92da-83649389a232'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.457069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] The token cache is being invalidate because project 1f0ec128e46641349d903c625157c907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:25:24.457391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.458089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20736efb-8d14-462d-92da-83649389a232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:24.459566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1139/2245] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:25:24 2022] DELETE /identity/v3/projects/1f0ec128e46641349d903c625157c907 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:25:30.675496 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:30.677072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:30.690432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd4c5-8c2d-4c34-97c4-e71064cc9fa1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:30.711605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:30.754615 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:30.755267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:30.755553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:30.755833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] PATH_INFO: `/v3/users/e148fb988b684352894a775c3c784e0b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:30.756985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e148fb988b684352894a775c3c784e0b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:30.758997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:30.792082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:30.793233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:30.793533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:30.812811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e148fb988b684352894a775c3c784e0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:30.813575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e148fb988b684352894a775c3c784e0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:30.815754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:30.817248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:30.822704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e148fb988b684352894a775c3c784e0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:30.826734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1140/2246] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:25:30.839715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e148fb988b684352894a775c3c784e0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:30.840582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-eb2e78e0-6570-4285-b0de-fd8d9e5f7d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e148fb988b684352894a775c3c784e0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:30.853136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:30.859087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:30.861585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1107/2247] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:25:30 2022] DELETE /identity/v3/users/e148fb988b684352894a775c3c784e0b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:25:30.866281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:30.866570 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:30.866852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:30.890950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:30.892687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:30.894154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:30.962443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d49ab-787d-4357-87c8-41a8fcb1c4b0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:30.963531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1108/2248] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:30.974029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:30.976729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:31.032803 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:31.051437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb022-35bf-4f02-875c-f416d502e521 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:31.056013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:31.056636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.056916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.057227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.068023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:31.069045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.069547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.069669 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:31.070111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.071130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:31.072500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:31.085060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:31.086721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf43330-da9a-42e2-b656-091657c088c0 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:31.087796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1109/2249] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:31.097941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1141/2250] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:31.504019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:31.506286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:31.523879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a63f3-bea0-4ef1-a4b8-02d2557f50b8 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:31.530080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:31.530966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.531364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.532360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] PATH_INFO: `/v3/projects/5647fc01664b446fba5cc62f211f14c9` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.533702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5647fc01664b446fba5cc62f211f14c9)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:31.536786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:31.601949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5647fc01664b446fba5cc62f211f14c9', 'request_id': 'req-a3e055f1-6888-4d0c-9e53-e569b2018b64'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:31.611490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5647fc01664b446fba5cc62f211f14c9', 'request_id': 'req-a3e055f1-6888-4d0c-9e53-e569b2018b64'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:31.641998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5647fc01664b446fba5cc62f211f14c9', 'request_id': 'req-a3e055f1-6888-4d0c-9e53-e569b2018b64'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:31.668256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] The token cache is being invalidate because project 5647fc01664b446fba5cc62f211f14c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:25:31.668561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:31.669330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a3e055f1-6888-4d0c-9e53-e569b2018b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:25:31.671086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1110/2251] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:25:31 2022] DELETE /identity/v3/projects/5647fc01664b446fba5cc62f211f14c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:25:31.675675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.675966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.676860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.700843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:31.702473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:31.777148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1142/2252] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:31.787197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900028d-566f-4c78-9294-df374941bc22 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.787756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900028d-566f-4c78-9294-df374941bc22 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.787875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900028d-566f-4c78-9294-df374941bc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.819353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b900028d-566f-4c78-9294-df374941bc22 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:31.820761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b900028d-566f-4c78-9294-df374941bc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:31.832196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1111/2253] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:31.833768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:31.845220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34880751-01fc-4ba0-ac3b-956b3a75bffc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:31.851079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:31.851820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.852198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.852570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.853507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:25:31.853933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:31.855654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:31.872182 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1143/2254] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:25:31.876892 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900028d-566f-4c78-9294-df374941bc22 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:31.909838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900028d-566f-4c78-9294-df374941bc22 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:31.919927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:31.920646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:31.921044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:31.921455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:31.922111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:31.924008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:31.954240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1112/2255] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:25:31 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:25:31.958461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:31.969065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaff92-f8ff-4fdc-9a0d-0f1517f4832e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:31.991548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:32.029253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:32.029864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:32.030145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:32.030418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:32.031065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:32.033007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:32.057038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1144/2256] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:25:31 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:25:32.061157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:32.071683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae04a8-faed-423c-aa57-e90738266007 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:32.076342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:32.076950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:32.077264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:32.077539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:32.078183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:32.079789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:32.093639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1113/2257] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:25:32.097842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:32.109515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ba118-5af0-402e-85e9-33b4851c614e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:32.114957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c16d-bf4a-4e5b-8be9-a7eb34008c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:32.115652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c16d-bf4a-4e5b-8be9-a7eb34008c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:32.115935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c16d-bf4a-4e5b-8be9-a7eb34008c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:32.116214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c16d-bf4a-4e5b-8be9-a7eb34008c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:32.116870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c16d-bf4a-4e5b-8be9-a7eb34008c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:32.118535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c16d-bf4a-4e5b-8be9-a7eb34008c22 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:32.130707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1145/2258] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:25:32.134702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:32.146514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0606e-a9e7-4cde-ae8f-72e38d5ebf8e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:32.151569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:32.152327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:32.152674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:32.153013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] PATH_INFO: `/v3/projects/7921457a52434b6bac9fa1ef497338ee/users/25cd98266d154dd2931c2ac2cecc8916/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:32.169629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7921457a52434b6bac9fa1ef497338ee, user_id=25cd98266d154dd2931c2ac2cecc8916, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:32.172492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:32.187086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1114/2259] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:25:32 2022] PUT /identity/v3/projects/7921457a52434b6bac9fa1ef497338ee/users/25cd98266d154dd2931c2ac2cecc8916/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:25:32.197591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d42c6-dec0-4d17-bafb-3b853deda773 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:32.198002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d42c6-dec0-4d17-bafb-3b853deda773 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:32.198283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d42c6-dec0-4d17-bafb-3b853deda773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:32.228537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6d5d42c6-dec0-4d17-bafb-3b853deda773 None None] MFA Rules not processed for user `25cd98266d154dd2931c2ac2cecc8916`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:32.229810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6d5d42c6-dec0-4d17-bafb-3b853deda773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:32.298394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1146/2260] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:25:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:32.309848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:32.311707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:32.382352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce7593-acd7-4ef8-906f-8d264b6a169e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:32.386348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1730cf0-5f6b-49c5-bc1a-98997f019a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:32.386993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730cf0-5f6b-49c5-bc1a-98997f019a27 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:32.387272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730cf0-5f6b-49c5-bc1a-98997f019a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:32.387978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1730cf0-5f6b-49c5-bc1a-98997f019a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:32.397884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730cf0-5f6b-49c5-bc1a-98997f019a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:32.399523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1730cf0-5f6b-49c5-bc1a-98997f019a27 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:32.409423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1115/2261] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:33.808772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b728c-2c42-491a-b65c-2ce475b22bd8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:33.809327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b728c-2c42-491a-b65c-2ce475b22bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:33.809478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b728c-2c42-491a-b65c-2ce475b22bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:33.830167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f18b728c-2c42-491a-b65c-2ce475b22bd8 None None] MFA Rules not processed for user `25cd98266d154dd2931c2ac2cecc8916`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:33.831408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f18b728c-2c42-491a-b65c-2ce475b22bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:33.839116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1147/2262] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:25:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:36.452851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:36.453410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:36.453410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:36.473401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:36.474683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:36.478916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:36.509979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94b510-e7ab-497a-93f7-a137808629c9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:36.510501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94b510-e7ab-497a-93f7-a137808629c9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:36.510843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94b510-e7ab-497a-93f7-a137808629c9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:36.513355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1148/2263] 10.222.0.88 () {54 vars in 961 bytes} [Mon Aug 29 23:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:25:36.517773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:36.518497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:36.518777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:36.552018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1116/2264] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:36.554201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] MFA Rules not processed for user `7401c08c5de0437f8a605594dcce9395`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:36.555865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:36.563242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:36.564881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:36.649442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1149/2265] 10.222.0.88 () {58 vars in 1058 bytes} [Mon Aug 29 23:25:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:25:36.650167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:36.651539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:36.678743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841348-ed26-4605-9fab-b2dcd7df481b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:36.679771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:25:36.686526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:36.687729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:36.688145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:36.688622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:36.691479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:36.707796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:36.709991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:36.721130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1117/2266] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:36.721976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:36.732981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3f9fc-6834-4c3e-bb52-f319b9d70e7e service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:36.739081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162e1b6-618b-4c7f-8555-997617a3df3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:36.739685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162e1b6-618b-4c7f-8555-997617a3df3f service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:36.739959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162e1b6-618b-4c7f-8555-997617a3df3f service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:36.740221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162e1b6-618b-4c7f-8555-997617a3df3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:36.749148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857516-f7d4-4cb3-9650-578fcf360995 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:36.751398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162e1b6-618b-4c7f-8555-997617a3df3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:36.753198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162e1b6-618b-4c7f-8555-997617a3df3f service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:36.760222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:36.761133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:36.761586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:36.761834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:36.763678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1118/2267] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:36.772076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:36.774984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:36.787264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1150/2268] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:41.750546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665814d-b5a8-43e4-a16d-095cfa26246b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:41.751115 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665814d-b5a8-43e4-a16d-095cfa26246b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:41.751115 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665814d-b5a8-43e4-a16d-095cfa26246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:41.772001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f665814d-b5a8-43e4-a16d-095cfa26246b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:41.773279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f665814d-b5a8-43e4-a16d-095cfa26246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:41.781567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1119/2269] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:41.808115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:41.819963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac3a7-ddeb-429e-81e3-484cf28c94e4 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:41.825544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:41.826163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:41.826451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:41.826721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:41.835774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:41.837387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:41.846619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1151/2270] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:45.793348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437e55-592b-4f73-b403-720a40057be0 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:45.793891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437e55-592b-4f73-b403-720a40057be0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:45.793891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a437e55-592b-4f73-b403-720a40057be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:45.817234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7a437e55-592b-4f73-b403-720a40057be0 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:45.818451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7a437e55-592b-4f73-b403-720a40057be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:45.915086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1120/2271] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:25:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:45.944879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:45.947028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:46.056884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28474a8-d1ad-4382-93b2-f4385428e1a9 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:46.063028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:46.063305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:46.063583 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:46.063920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:46.075558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:46.077221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:46.091535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1152/2272] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:25:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:25:46.934684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecadf77-36c6-476f-bade-4fd59f190ca1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:46.935252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecadf77-36c6-476f-bade-4fd59f190ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:46.935252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecadf77-36c6-476f-bade-4fd59f190ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:46.972344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-aecadf77-36c6-476f-bade-4fd59f190ca1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:46.975256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aecadf77-36c6-476f-bade-4fd59f190ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:46.986866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1121/2273] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:25:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:47.008452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:47.011062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:47.030228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de1d34-ecee-43f4-8b58-eb084cdfb03a service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:47.040352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:47.040986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:47.041301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:47.041568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:47.067384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:47.069346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:47.083796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1153/2274] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:53.267617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8ba9-df51-4524-aa58-f4ff4c2dc3b4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:53.268626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8ba9-df51-4524-aa58-f4ff4c2dc3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:53.268626 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8ba9-df51-4524-aa58-f4ff4c2dc3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:53.290582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-939b8ba9-df51-4524-aa58-f4ff4c2dc3b4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:53.291990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-939b8ba9-df51-4524-aa58-f4ff4c2dc3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:53.303720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1122/2275] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:53.334932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:53.349203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e958-86a4-4feb-a48d-64cab00df6ab service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:53.355104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:53.356905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:53.357385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:53.357969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:53.368651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:53.370270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:53.385132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1154/2276] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:25:58.488687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6137-dd2c-40a9-9e2d-c934f91e9723 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:58.489348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6137-dd2c-40a9-9e2d-c934f91e9723 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:58.489348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c6137-dd2c-40a9-9e2d-c934f91e9723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:58.509681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ad5c6137-dd2c-40a9-9e2d-c934f91e9723 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:25:58.511062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ad5c6137-dd2c-40a9-9e2d-c934f91e9723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:25:58.519522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1123/2277] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:25:58.536402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:25:58.547497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed895-c2f5-4bdc-b414-2960f0661122 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:25:58.553833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509d2f-2e16-450d-aa50-eb4ee15fd7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:25:58.554438 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509d2f-2e16-450d-aa50-eb4ee15fd7d7 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:25:58.554717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509d2f-2e16-450d-aa50-eb4ee15fd7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:25:58.555022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509d2f-2e16-450d-aa50-eb4ee15fd7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:25:58.563819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35509d2f-2e16-450d-aa50-eb4ee15fd7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:25:58.565379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35509d2f-2e16-450d-aa50-eb4ee15fd7d7 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:25:58.575825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1155/2278] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:26:05.432512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144f43-0bdf-444e-adc1-53012e875ee0 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.433064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144f43-0bdf-444e-adc1-53012e875ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.433356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85144f43-0bdf-444e-adc1-53012e875ee0 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.434736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1124/2279] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:26:05.441747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d815-bba9-4241-af13-4a7c456663e9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.442259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d815-bba9-4241-af13-4a7c456663e9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.442377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d815-bba9-4241-af13-4a7c456663e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.462862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5db8d815-bba9-4241-af13-4a7c456663e9 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:05.464078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5db8d815-bba9-4241-af13-4a7c456663e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:05.473742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1156/2280] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:26:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:05.485831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85144f43-0bdf-444e-adc1-53012e875ee0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:05.487531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-85144f43-0bdf-444e-adc1-53012e875ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:05.495395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:05.549188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85144f43-0bdf-444e-adc1-53012e875ee0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:05.553230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ac70-df91-4cd6-bcd5-6dbb0ebf2c65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:05.554005 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ac70-df91-4cd6-bcd5-6dbb0ebf2c65 service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.554428 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ac70-df91-4cd6-bcd5-6dbb0ebf2c65 service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.554769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ac70-df91-4cd6-bcd5-6dbb0ebf2c65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.566515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019ac70-df91-4cd6-bcd5-6dbb0ebf2c65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:05.567959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019ac70-df91-4cd6-bcd5-6dbb0ebf2c65 service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:05.578486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1125/2281] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:26:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:26:05.651186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d33de-214b-48f1-a8a8-f0ade79aba02 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.651473 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d33de-214b-48f1-a8a8-f0ade79aba02 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.651744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d33de-214b-48f1-a8a8-f0ade79aba02 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.653079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1157/2282] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:26:05.657811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c464e91-2285-4ee6-98cf-a853fff03415 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.658118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c464e91-2285-4ee6-98cf-a853fff03415 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.658414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c464e91-2285-4ee6-98cf-a853fff03415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.679186 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4c464e91-2285-4ee6-98cf-a853fff03415 None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:05.680487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4c464e91-2285-4ee6-98cf-a853fff03415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:05.737751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1126/2283] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:26:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:05.750031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d33de-214b-48f1-a8a8-f0ade79aba02 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:05.751862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-466d33de-214b-48f1-a8a8-f0ade79aba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:05.765404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d33de-214b-48f1-a8a8-f0ade79aba02 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:05.768895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f188ad9-4ffb-4a5b-86a9-0d22fba981d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:05.770239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188ad9-4ffb-4a5b-86a9-0d22fba981d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.770521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188ad9-4ffb-4a5b-86a9-0d22fba981d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.770797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f188ad9-4ffb-4a5b-86a9-0d22fba981d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.777654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188ad9-4ffb-4a5b-86a9-0d22fba981d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:05.779084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f188ad9-4ffb-4a5b-86a9-0d22fba981d2 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:05.786865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1158/2284] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:26:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:26:05.874029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d9aa-ca61-4b8d-8f23-96b0c7e244de None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.874320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d9aa-ca61-4b8d-8f23-96b0c7e244de None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.874639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38d9aa-ca61-4b8d-8f23-96b0c7e244de None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.876337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1127/2285] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:26:05.882178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f958e13-a6a9-4b39-bc33-105ce0b1480a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.882465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f958e13-a6a9-4b39-bc33-105ce0b1480a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.882738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f958e13-a6a9-4b39-bc33-105ce0b1480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.903485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7f958e13-a6a9-4b39-bc33-105ce0b1480a None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:05.904696 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7f958e13-a6a9-4b39-bc33-105ce0b1480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:05.914402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1159/2286] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:26:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:05.925153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38d9aa-ca61-4b8d-8f23-96b0c7e244de None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:05.936994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38d9aa-ca61-4b8d-8f23-96b0c7e244de None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:05.940727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:05.942400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:05.942824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:05.943109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:05.953879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:05.955350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:05.966359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1128/2287] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:26:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:26:15.898396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:15.961606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=53 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:20.933866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f87e6-5849-4f01-8630-e4e459a99ba6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:20.934347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f87e6-5849-4f01-8630-e4e459a99ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:20.934444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f87e6-5849-4f01-8630-e4e459a99ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:20.953964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ce2f87e6-5849-4f01-8630-e4e459a99ba6 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:20.955150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ce2f87e6-5849-4f01-8630-e4e459a99ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:20.963126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1160/2288] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:26:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:20.975730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:20.987546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb75950-def7-429b-bf12-7d8f2bd7e16e service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:20.992636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:20.993280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:20.993562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:20.993837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:21.002225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:21.003831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:21.012883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1129/2289] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:26:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:26:21.592658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ef44-8a63-43ae-84cf-90720055b388 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:21.592974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ef44-8a63-43ae-84cf-90720055b388 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:21.593345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5ef44-8a63-43ae-84cf-90720055b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:21.613300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c5a5ef44-8a63-43ae-84cf-90720055b388 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:21.614956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c5a5ef44-8a63-43ae-84cf-90720055b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:21.627379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1161/2290] 10.222.0.88 () {58 vars in 967 bytes} [Mon Aug 29 23:26:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:21.648933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:21.663029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881ccf3-637b-4051-af2c-52150e2e99f3 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:21.668360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:21.668971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:21.669282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:21.669556 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:21.679054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:21.680624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:21.690084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1130/2291] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:26:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:26:21.928181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1536e-4394-486c-a2dd-a004b41f68fa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:21.928485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1536e-4394-486c-a2dd-a004b41f68fa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:21.928778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1536e-4394-486c-a2dd-a004b41f68fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:21.950687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-40a1536e-4394-486c-a2dd-a004b41f68fa None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:21.951916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-40a1536e-4394-486c-a2dd-a004b41f68fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:21.960900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1162/2292] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:26:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:21.974087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:21.986059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc2ca-3db2-4fed-9fa5-066e78edc966 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:21.991978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:21.992577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:21.992859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:21.993153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:22.001345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:22.002927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:22.011153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1131/2293] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:26:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:26:22.374101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089033-c25b-4f56-8602-bef3d6ddf351 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:22.374497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089033-c25b-4f56-8602-bef3d6ddf351 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:22.374885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7089033-c25b-4f56-8602-bef3d6ddf351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:22.395760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c7089033-c25b-4f56-8602-bef3d6ddf351 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:22.396965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c7089033-c25b-4f56-8602-bef3d6ddf351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:22.404085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1163/2294] 10.222.0.88 () {58 vars in 967 bytes} [Mon Aug 29 23:26:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:22.416858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:22.428190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7633c-3734-48ef-b93a-f0535b04bb87 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:22.433323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:22.433921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:22.434400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:22.434689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:22.443719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:22.445318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:22.453490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1132/2295] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:26:23.213453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:23.213858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:23.214198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:23.234179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:23.235408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:23.243992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1164/2296] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:23.257261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:23.269975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2aa17-4d40-4c8e-bcf3-918a98e449c7 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:23.274946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978118dc-dfe4-4339-8b4c-62bab56db4e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:23.275545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978118dc-dfe4-4339-8b4c-62bab56db4e7 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:23.275889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978118dc-dfe4-4339-8b4c-62bab56db4e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:23.276164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978118dc-dfe4-4339-8b4c-62bab56db4e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:23.284905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978118dc-dfe4-4339-8b4c-62bab56db4e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:23.286890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978118dc-dfe4-4339-8b4c-62bab56db4e7 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:23.299500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1133/2297] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:26:24.660577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:24.672629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f5c4-0fcb-4862-8cbe-28fd86ed9c61 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:24.680963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:24.681720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:24.682072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:24.682420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] PATH_INFO: `/v3/users/25cd98266d154dd2931c2ac2cecc8916` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:24.683664 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=25cd98266d154dd2931c2ac2cecc8916)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:24.685776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:24.738212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25cd98266d154dd2931c2ac2cecc8916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:24.739051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25cd98266d154dd2931c2ac2cecc8916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:24.747444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25cd98266d154dd2931c2ac2cecc8916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:24.755849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25cd98266d154dd2931c2ac2cecc8916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:24.756536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25cd98266d154dd2931c2ac2cecc8916'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:24.777527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1165/2298] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:26:24 2022] DELETE /identity/v3/users/25cd98266d154dd2931c2ac2cecc8916 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:26:24.782064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:24.782541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:24.782636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:24.802898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:24.804107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:24.870646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1134/2299] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:24.881708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:24.884086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:24.956952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b13223-2a12-47eb-a0a8-6afee46bb6cd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:24.961029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cea89-359a-4316-8b3e-27cae3ac55c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:24.961685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cea89-359a-4316-8b3e-27cae3ac55c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:24.962050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cea89-359a-4316-8b3e-27cae3ac55c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:24.962226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cea89-359a-4316-8b3e-27cae3ac55c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:24.972330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cea89-359a-4316-8b3e-27cae3ac55c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:24.973821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cea89-359a-4316-8b3e-27cae3ac55c6 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:24.984997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1166/2300] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:26:25.170866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:25.172335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:25.205964 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83e54a-81f2-421e-bff1-393cd7cc6ff4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:25.211712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:25.212363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:25.212638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:25.212911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] PATH_INFO: `/v3/projects/7921457a52434b6bac9fa1ef497338ee` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:25.214454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7921457a52434b6bac9fa1ef497338ee)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:25.216681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:25.310916 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7921457a52434b6bac9fa1ef497338ee', 'request_id': 'req-9284b6f3-a1dd-4f78-9417-4feac50ae634'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:25.322123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7921457a52434b6bac9fa1ef497338ee', 'request_id': 'req-9284b6f3-a1dd-4f78-9417-4feac50ae634'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:25.346197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7921457a52434b6bac9fa1ef497338ee', 'request_id': 'req-9284b6f3-a1dd-4f78-9417-4feac50ae634'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:25.361162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] The token cache is being invalidate because project 7921457a52434b6bac9fa1ef497338ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:26:25.361564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:25.363104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9284b6f3-a1dd-4f78-9417-4feac50ae634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:26:25.367004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1135/2301] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:26:25 2022] DELETE /identity/v3/projects/7921457a52434b6bac9fa1ef497338ee => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:26:27.781541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:27.782103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:27.782103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:27.802019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] MFA Rules not processed for user `7909e27d955146fcb172cb3ff199853d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:27.803219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:27.843053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:27.861286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1167/2302] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:26:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:35.356901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:37.854460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:46.698263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9265d-f897-4a7d-97d4-ad20b45549ff None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:46.698764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9265d-f897-4a7d-97d4-ad20b45549ff None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:46.699060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9265d-f897-4a7d-97d4-ad20b45549ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:46.720831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d0a9265d-f897-4a7d-97d4-ad20b45549ff None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:46.722174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d0a9265d-f897-4a7d-97d4-ad20b45549ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:46.786464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1136/2303] 10.222.0.88 () {58 vars in 967 bytes} [Mon Aug 29 23:26:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:46.809842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:46.811335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:46.882870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b049f78-abdb-45b2-8aa3-59e44a514e75 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:46.887587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:46.888193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:46.888584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:46.888858 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:46.897770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:46.900315 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:46.909237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1168/2304] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:26:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:26:56.778201 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=25 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:56.905204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=32 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:26:57.531135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2609-e8b9-4925-b1ea-721870309694 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:57.531402 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2609-e8b9-4925-b1ea-721870309694 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:57.531682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2609-e8b9-4925-b1ea-721870309694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:57.552709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ca6a2609-e8b9-4925-b1ea-721870309694 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:26:57.553947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ca6a2609-e8b9-4925-b1ea-721870309694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:57.614476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1137/2305] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:26:57.631165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:26:57.632580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:26:57.706236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24198-3839-4255-a637-b9cdbb94c6c2 service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:26:57.711866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:26:57.712461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:26:57.712743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:26:57.713019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:26:57.721318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:26:57.722913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:26:57.732470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1169/2306] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:02.839245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bf17-8928-4959-98a1-d00749f30c56 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:02.841178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bf17-8928-4959-98a1-d00749f30c56 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:02.841923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70bf17-8928-4959-98a1-d00749f30c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:02.885058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8f70bf17-8928-4959-98a1-d00749f30c56 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:02.886406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8f70bf17-8928-4959-98a1-d00749f30c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:02.897363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1138/2307] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:27:02.920611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:02.922078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:02.945015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b343f3-8c14-470a-9176-72f1407f7c0c service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:02.952218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:02.953095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:02.953407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:02.953866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:02.966188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:02.968592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:02.980048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1170/2308] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:27:05.934184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af175ff3-ac16-4290-a1f5-96806c49febe None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:05.934745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af175ff3-ac16-4290-a1f5-96806c49febe None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:05.934745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af175ff3-ac16-4290-a1f5-96806c49febe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:05.954939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-af175ff3-ac16-4290-a1f5-96806c49febe None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:05.956698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-af175ff3-ac16-4290-a1f5-96806c49febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:05.964793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1139/2309] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:27:05.985356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:05.997606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8d7a2-1383-4c57-9d52-2153a055284e service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:06.004513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323ea5c-6327-458f-89eb-d7d75fc3d878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:06.005244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ea5c-6327-458f-89eb-d7d75fc3d878 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:06.005600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ea5c-6327-458f-89eb-d7d75fc3d878 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:06.006356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323ea5c-6327-458f-89eb-d7d75fc3d878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:06.015481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323ea5c-6327-458f-89eb-d7d75fc3d878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:06.017091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323ea5c-6327-458f-89eb-d7d75fc3d878 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:06.027912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1171/2310] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:08.937441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:08.937972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:08.938082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:08.958238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] MFA Rules not processed for user `4cc14630ede646698bb19f803e9952ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:08.959417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:09.013423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1140/2311] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:27:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:27:10.120587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914916-2c15-4f79-a25b-04a8902b8e9e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:10.121188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914916-2c15-4f79-a25b-04a8902b8e9e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:10.121188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914916-2c15-4f79-a25b-04a8902b8e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:10.144034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bb914916-2c15-4f79-a25b-04a8902b8e9e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:10.145363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb914916-2c15-4f79-a25b-04a8902b8e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:10.153339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1172/2312] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:27:10.173235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:10.186536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22812499-26b4-4bf3-b837-60e25cf4d5b5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:10.193369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:10.194089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:10.194443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:10.194783 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:10.203485 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:10.205735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:10.215764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1141/2313] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:14.348337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec579-d68c-40d7-86fe-e402b56f6fe1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:14.348821 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec579-d68c-40d7-86fe-e402b56f6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:14.348973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ec579-d68c-40d7-86fe-e402b56f6fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:14.368005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-336ec579-d68c-40d7-86fe-e402b56f6fe1 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:14.369223 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-336ec579-d68c-40d7-86fe-e402b56f6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:14.377478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1173/2314] 10.222.0.86 () {58 vars in 1016 bytes} [Mon Aug 29 23:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:27:14.395546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:14.406848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa6fa7-d8b5-4912-9a42-167f6ec675f0 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:14.413091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:14.413721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:14.414009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:14.414286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:14.422780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:14.424972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:14.434725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1142/2315] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:22.275548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:22.276072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:22.276072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:22.297787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] MFA Rules not processed for user `642764a1a825436bb4912e33f2cb4135`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:22.299627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:22.358906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1174/2316] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:27:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:27:24.430372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=70 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:24.704370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:24.705982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:24.793546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7c1fe-cbe7-449a-ab15-a4e8ad8f32a6 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:24.798870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:24.799301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.799593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.800069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.802106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:24.823262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:24.825320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:24.840853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1143/2317] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:26.108901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:26.121163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987235-5811-4bef-b968-05a0f4691bee None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:26.126486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:26.128065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:26.128599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:26.129091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:26.132472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:26.150655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:26.152104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb4e8-a7e3-4795-8dc6-3bb83d9cbd09 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:26.165228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1175/2318] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:27:34.834701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=26 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:36.160015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=83 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:40.696979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:40.708690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3805e2d-b308-4399-97fa-55a46a037cab service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:40.714095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:40.714693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:40.714970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:40.715242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:40.716984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:40.775334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:40.776924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:40.785891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1144/2319] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:50.581033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.581603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.581603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.601899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] MFA Rules not processed for user `45416134d3204770a6ddc7f61538fc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:50.603197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:50.610073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1176/2320] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:27:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:27:50.781676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=28 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:50.927942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.937250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe96a-5f7e-4ef2-9392-bf8655e686b4 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.941627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.942223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.942495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.942762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.944501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:50.953815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:50.956273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:50.964087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1145/2321] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:51.292352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.293932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:51.366381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf5390-d8a3-4f72-b656-705ba7e51f0b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.371293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.371896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.372172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.372440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.374165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:51.385451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.387034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.397351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1177/2322] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:27:55.567598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.569277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:55.583847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b87bf7-d70d-4184-9281-ae5b25ef242e service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.588325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.588951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.589266 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.589540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] PATH_INFO: `/v3/users/7909e27d955146fcb172cb3ff199853d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.590785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7909e27d955146fcb172cb3ff199853d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.592681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.640958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7909e27d955146fcb172cb3ff199853d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.641703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7909e27d955146fcb172cb3ff199853d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.649523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7909e27d955146fcb172cb3ff199853d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.662271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7909e27d955146fcb172cb3ff199853d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.663153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7909e27d955146fcb172cb3ff199853d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.676267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1146/2323] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:27:55 2022] DELETE /identity/v3/users/7909e27d955146fcb172cb3ff199853d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:55.846838 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.858796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64a97-abda-45f1-b011-ffc4d674aa09 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.919021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.919653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.919932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.920204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] PATH_INFO: `/v3/projects/d39674329e3b40d0ade90aef9914497d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.921364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39674329e3b40d0ade90aef9914497d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.923425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.976633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39674329e3b40d0ade90aef9914497d', 'request_id': 'req-404136a7-2fcb-48ee-9efc-b09d208dcbb5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.983238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39674329e3b40d0ade90aef9914497d', 'request_id': 'req-404136a7-2fcb-48ee-9efc-b09d208dcbb5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:55.986743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.988595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:55.992867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39674329e3b40d0ade90aef9914497d', 'request_id': 'req-404136a7-2fcb-48ee-9efc-b09d208dcbb5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:56.009980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] The token cache is being invalidate because project d39674329e3b40d0ade90aef9914497d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:27:56.010727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:56.011919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:27:56.014233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1178/2324] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:27:55 2022] DELETE /identity/v3/projects/d39674329e3b40d0ade90aef9914497d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:27:56.059311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7574950-7ff2-459c-8659-544fd6155e48 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.121071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.121720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.122026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.122302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:56.124148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:56.134690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:56.136170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:56.146234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1147/2325] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:06.007056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:06.140939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:13.379751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:13.381193 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:13.439787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404136a7-2fcb-48ee-9efc-b09d208dcbb5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:13.444608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:13.445200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.445485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.445760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.447593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:13.508523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:13.510015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bbb45-2bda-4d4f-9582-95faabce86b8 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:13.519975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1179/2326] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:17.977303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:17.978965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:18.089698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ac09-6a0e-482c-9703-511d62f11584 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.096020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.096661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.096940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.097244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.099470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:18.115707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:18.117624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:18.133571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1148/2327] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:21.902333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.902835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.902936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.921818 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] MFA Rules not processed for user `55c184b749004ac298bb634bc948c537`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:21.923024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:21.929815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1180/2328] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:22.232211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:22.233640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:22.244874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156aa2-ace5-458c-b741-3e131806bcd5 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:22.248462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:22.249046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:22.249348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:22.249616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:22.251367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:22.260359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:22.261805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:22.270611 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1149/2329] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:26.468593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:26.478773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bee71-3cda-43bd-a702-c2298cdd04d2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:26.482323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:26.482914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:26.483195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:26.483468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:26.485895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:26.545994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:26.547445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:26.556431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1181/2330] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:31.904140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.918323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1f1f-2596-46b1-ac52-6753933ca248 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.924657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.925378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.925647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.925925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.927812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:31.997243 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.998859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.010599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1150/2331] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:32.047722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.050120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:32.067374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238d28f-0b16-4e62-a6cd-007f6f71be7b service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.073566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.074179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.074458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.074730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.076444 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:32.089608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.091199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c77b6-c301-4440-88ac-fa49d572060b service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.102968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1182/2332] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:42.005741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=68 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:42.098809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.696048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.706941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6acdc-f151-4a23-b6bf-9d1c2ada2beb service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.712581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.713352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.713578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.713855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.715595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:43.728185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.729791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.740163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1151/2333] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:48.091113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.091640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.091740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.111014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] MFA Rules not processed for user `4cc14630ede646698bb19f803e9952ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:48.112216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:48.119245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1183/2334] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:51.433312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.442454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811e89d-c55c-42f1-973a-ecfc99f3b582 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:51.446344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:51.446976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.447251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.447518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.449298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:51.526276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:51.527770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:51.540982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1152/2335] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:54.932909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.935481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.003914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.005709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.021665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a31adc-8cf0-4ba0-8e17-9bd691fb3c4f service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.026363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.026990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.027261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.027526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] PATH_INFO: `/v3/users/642764a1a825436bb4912e33f2cb4135` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.028658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642764a1a825436bb4912e33f2cb4135)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.030609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.037793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da06337-24f3-480e-8ea8-a0b16ab1bec0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.043211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.043874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.044345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.044717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.047310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.060715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.063314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.074294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1184/2336] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:55.086581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642764a1a825436bb4912e33f2cb4135'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.087355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642764a1a825436bb4912e33f2cb4135'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.095091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642764a1a825436bb4912e33f2cb4135'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.107908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642764a1a825436bb4912e33f2cb4135'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.108577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-62848cca-3f22-4fb9-a56e-2448f8c568a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642764a1a825436bb4912e33f2cb4135'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.122221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1153/2337] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:28:55 2022] DELETE /identity/v3/users/642764a1a825436bb4912e33f2cb4135 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:28:55.290329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.301713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f62b3-ba90-4e68-808d-7f4a26f7a9d1 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.358505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.359657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.359931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.360202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] PATH_INFO: `/v3/projects/8db22cc5f6574330a6b27b36a3344248` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.361337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db22cc5f6574330a6b27b36a3344248)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.363236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.408263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db22cc5f6574330a6b27b36a3344248', 'request_id': 'req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.413761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db22cc5f6574330a6b27b36a3344248', 'request_id': 'req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.420967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db22cc5f6574330a6b27b36a3344248', 'request_id': 'req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.432494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] The token cache is being invalidate because project 8db22cc5f6574330a6b27b36a3344248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:28:55.432794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.433435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bbcf4c5-39b1-4be9-a582-18e7da5b2b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:55.434910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1185/2338] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:28:55 2022] DELETE /identity/v3/projects/8db22cc5f6574330a6b27b36a3344248 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:55.439781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.440069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.440349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.459870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:55.461096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.506831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.519674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1154/2339] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:55.527495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.527782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.528054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.549773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:55.550895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.558652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1186/2340] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:55.563323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.572946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc228ed0-4bfd-4405-b3b3-c4866d987bfc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.577591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.578262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.578544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.578820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.579548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:55.579978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.581703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.594062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1155/2341] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:55.598480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.607810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda4fde-2e95-4ef0-bb98-f15a7174dd08 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.613217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.613817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.614097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.614371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.615043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.616945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.621506 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.648731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1187/2342] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:55.649546 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.665671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65721b21-dbe7-4a0f-a674-5ca2fdfc758e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.724399 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.725011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.725328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.725603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.726233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.728159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.753337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1156/2343] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:28:55.754649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.766185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e76d2-c4b7-467a-b123-7801ab7cc785 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.770930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.771562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.771844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.772122 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.772765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.774471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.784836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1188/2344] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:55.789043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.799951 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c8a10-d9c8-4a64-aeb0-8889ccb898e8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.804595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c3a89-f3bc-4da4-87e9-0dc301626d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.805307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c3a89-f3bc-4da4-87e9-0dc301626d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.805667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c3a89-f3bc-4da4-87e9-0dc301626d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.806003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c3a89-f3bc-4da4-87e9-0dc301626d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.806647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c3a89-f3bc-4da4-87e9-0dc301626d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.808276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c3a89-f3bc-4da4-87e9-0dc301626d55 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.819403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1157/2345] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:55.823697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.833911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7dde-d1da-491d-b46b-ef7ae90c0366 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.838533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.839172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.839443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.839710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] PATH_INFO: `/v3/projects/f18bba32aa104aa29b6d8c8a791a7127/users/f4549e2587764f2fabb362626d76587c/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.853932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18bba32aa104aa29b6d8c8a791a7127, user_id=f4549e2587764f2fabb362626d76587c, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.856551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.870048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1189/2346] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:28:55 2022] PUT /identity/v3/projects/f18bba32aa104aa29b6d8c8a791a7127/users/f4549e2587764f2fabb362626d76587c/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:55.881974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.882261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.882540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.909560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] MFA Rules not processed for user `f4549e2587764f2fabb362626d76587c`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:55.910770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.975968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1158/2347] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:55.980537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.048280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026383c-cdd5-4e26-8970-6208f4798c1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.054811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.055370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.055735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.056054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.056708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.058663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.096794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1190/2348] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:56.100579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.114290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed74f9-2410-4119-8c78-98e42e417020 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.170195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:56.185571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.186294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.186577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.187416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.188154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.190301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.216253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1159/2349] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:28:56 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:56.221472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.233617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d7a17-d5c1-4942-87c6-8121f8478562 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.238486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.239092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.239377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.239678 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.240358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.241995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.253745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1191/2350] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:28:56.257984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.268826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0101e2e-2c89-4d17-b718-b3c3c25371de admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.273633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.274278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.274564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.274839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] PATH_INFO: `/v3/projects/19e403b07bee4e09868cfe4474eafb08/users/f70d90b0f396469692aca93871cebaab/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.289627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e403b07bee4e09868cfe4474eafb08, user_id=f70d90b0f396469692aca93871cebaab, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.292257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.305728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1160/2351] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:28:56 2022] PUT /identity/v3/projects/19e403b07bee4e09868cfe4474eafb08/users/f70d90b0f396469692aca93871cebaab/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:56.309647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.320915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6623785-5930-44b1-a93b-8393b345d795 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.377580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8726e-c11e-4cf6-a225-436274a491c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.378186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8726e-c11e-4cf6-a225-436274a491c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.378470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8726e-c11e-4cf6-a225-436274a491c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.378745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8726e-c11e-4cf6-a225-436274a491c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.379393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8726e-c11e-4cf6-a225-436274a491c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.381018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8726e-c11e-4cf6-a225-436274a491c3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.390990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1192/2352] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:56.395167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.405379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb111da-8d22-4675-951e-02a7d58b06e1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.410709 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.411365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.411644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.411947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] PATH_INFO: `/v3/projects/19e403b07bee4e09868cfe4474eafb08/users/f70d90b0f396469692aca93871cebaab/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.414118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e403b07bee4e09868cfe4474eafb08, user_id=f70d90b0f396469692aca93871cebaab, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.416739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.427717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1161/2353] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:28:56 2022] PUT /identity/v3/projects/19e403b07bee4e09868cfe4474eafb08/users/f70d90b0f396469692aca93871cebaab/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:28:56.438005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.438298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.438585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.466275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] MFA Rules not processed for user `f70d90b0f396469692aca93871cebaab`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:56.467507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:56.476192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:56.540007 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1193/2354] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:56.552557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.554337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:56.613578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f1ea5-f97a-4f6c-b257-c51db31f2d0b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.617541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.617809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.618092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.618367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.628569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.630037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.639474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1162/2355] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:56.946743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.956406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0e599-df26-41f9-a393-e9dd59ff2ac8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.960914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70d90b0f396469692aca93871cebaab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19e403b07bee4e09868cfe4474eafb08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.961543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.961827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.962100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.962742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:56.963041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.964624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.976436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1194/2356] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:56.980427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.990016 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef2a5a-fb8b-4e7d-99ff-222c6ddf6492 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.994524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70d90b0f396469692aca93871cebaab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19e403b07bee4e09868cfe4474eafb08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.995107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.995384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.995658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.996273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.998198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.024767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1163/2357] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:28:56 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:57.028795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.039246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef5aa8-aa3e-4dc8-9651-58946c615e60 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.094809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70d90b0f396469692aca93871cebaab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19e403b07bee4e09868cfe4474eafb08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.095413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.095698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.095977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.096647 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:57.096955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.098604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.116938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1195/2358] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:57.154051 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.165656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88270bdb-4b2e-4be1-97ec-71ca0ba0c36b tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.170335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f70d90b0f396469692aca93871cebaab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '19e403b07bee4e09868cfe4474eafb08', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.170958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.171818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.172129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] PATH_INFO: `/v3/projects/64b58fee4c894ca1b0bb92fd3d9f29bd` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.173224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64b58fee4c894ca1b0bb92fd3d9f29bd)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.175161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.223625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b58fee4c894ca1b0bb92fd3d9f29bd', 'request_id': 'req-aec86d6f-f5bb-4096-8502-76feab2746a4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.233331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b58fee4c894ca1b0bb92fd3d9f29bd', 'request_id': 'req-aec86d6f-f5bb-4096-8502-76feab2746a4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.245925 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b58fee4c894ca1b0bb92fd3d9f29bd', 'request_id': 'req-aec86d6f-f5bb-4096-8502-76feab2746a4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.257460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] The token cache is being invalidate because project 64b58fee4c894ca1b0bb92fd3d9f29bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:28:57.257747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.258453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-aec86d6f-f5bb-4096-8502-76feab2746a4 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.260177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1164/2359] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:28:57 2022] DELETE /identity/v3/projects/64b58fee4c894ca1b0bb92fd3d9f29bd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:57.455405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.457264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:57.520570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8f114-3296-4c3d-b7fa-766c345f27d3 tempest-VolumeQuotaClassesTest-410986356 tempest-VolumeQuotaClassesTest-410986356-project-admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.550156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:57.576408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.577036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.577372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.577641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] PATH_INFO: `/v3/users/f4549e2587764f2fabb362626d76587c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.578759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4549e2587764f2fabb362626d76587c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.580672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.630714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4549e2587764f2fabb362626d76587c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.631365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4549e2587764f2fabb362626d76587c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.639150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4549e2587764f2fabb362626d76587c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.647585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4549e2587764f2fabb362626d76587c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.648299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4549e2587764f2fabb362626d76587c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:57.665924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1196/2360] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:28:57 2022] DELETE /identity/v3/users/f4549e2587764f2fabb362626d76587c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:57.670338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.670617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.670884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.678672 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:57.690604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:57.691739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:57.748730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1165/2361] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:57.758920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.760327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:57.818901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59839f84-1783-4646-8733-de47fdc6642e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.822536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.823140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.823422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.823697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.833332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.834761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.844432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1197/2362] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:28:58.113789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.117043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:58.133238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d39428-6fb6-430b-bf7f-cd65573336cf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.138255 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.138979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.139324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.139663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] PATH_INFO: `/v3/projects/f18bba32aa104aa29b6d8c8a791a7127` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.141645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18bba32aa104aa29b6d8c8a791a7127)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.143609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.197250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18bba32aa104aa29b6d8c8a791a7127', 'request_id': 'req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.205852 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18bba32aa104aa29b6d8c8a791a7127', 'request_id': 'req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.213443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18bba32aa104aa29b6d8c8a791a7127', 'request_id': 'req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.225867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] The token cache is being invalidate because project f18bba32aa104aa29b6d8c8a791a7127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:28:58.226199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.227000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.228575 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1166/2363] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:28:58 2022] DELETE /identity/v3/projects/f18bba32aa104aa29b6d8c8a791a7127 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:58.232926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.256141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a628e-b162-4391-9719-ae76c46e7ac9 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.313102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.322032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.322680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.322958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.323290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] PATH_INFO: `/v3/users/f70d90b0f396469692aca93871cebaab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.324498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70d90b0f396469692aca93871cebaab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.327796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.384623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70d90b0f396469692aca93871cebaab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.385939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70d90b0f396469692aca93871cebaab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.394375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70d90b0f396469692aca93871cebaab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.402705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70d90b0f396469692aca93871cebaab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.403517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1df84794-4fda-4253-b1ce-b5164385de7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70d90b0f396469692aca93871cebaab'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.425153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1198/2364] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:28:58 2022] DELETE /identity/v3/users/f70d90b0f396469692aca93871cebaab => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:58.740377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.741888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:58.757676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec67f7a-dc80-4f6c-be32-4b1d8ddd4879 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.815182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.815815 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.816096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.816372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] PATH_INFO: `/v3/projects/19e403b07bee4e09868cfe4474eafb08` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.817521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e403b07bee4e09868cfe4474eafb08)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.819423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.853836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.869268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e403b07bee4e09868cfe4474eafb08', 'request_id': 'req-975098d0-9849-4569-ae90-f6ec5905787a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.878353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e403b07bee4e09868cfe4474eafb08', 'request_id': 'req-975098d0-9849-4569-ae90-f6ec5905787a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.884761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e403b07bee4e09868cfe4474eafb08', 'request_id': 'req-975098d0-9849-4569-ae90-f6ec5905787a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.895019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] The token cache is being invalidate because project 19e403b07bee4e09868cfe4474eafb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:28:58.895306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.895931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-975098d0-9849-4569-ae90-f6ec5905787a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:28:58.897443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1167/2365] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:28:58 2022] DELETE /identity/v3/projects/19e403b07bee4e09868cfe4474eafb08 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:58.902711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.903076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.903426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.923564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:58.924773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:58.984579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1199/2366] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:58.992262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.992544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.992818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.012462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:59.013699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:59.022326 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1168/2367] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:59.026661 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.036802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d62ce6-4460-4f55-804d-a4f617c88ff0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.041917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.042517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.042799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.043071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.043910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:59.044308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.046033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.058321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1200/2368] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:59.062909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.072108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede84632-1e5d-4740-ab13-c2fc7e458dae None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.076710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.077893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.078218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.078500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.079133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.081030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.108062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1169/2369] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:28:59.112482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.122728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f7a7-3a9a-4bc7-a7ad-00908ac40d9e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.180770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.181407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.181694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.181970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.182598 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.184562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.193897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.209202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1201/2370] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:59.211488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.222182 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871cba-592f-44cd-96d0-4dfa95f1bb47 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.226820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.227416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.227713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.227969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.228609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.230232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.240137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1170/2371] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:59.244085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.254755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481116ea-d788-40ac-8b47-3b9946fbd0f7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.259937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01335a7f-8dbb-4dc8-8a35-6f8c09eb2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.260543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01335a7f-8dbb-4dc8-8a35-6f8c09eb2cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.260831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01335a7f-8dbb-4dc8-8a35-6f8c09eb2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.261153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01335a7f-8dbb-4dc8-8a35-6f8c09eb2cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.261787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01335a7f-8dbb-4dc8-8a35-6f8c09eb2cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.263428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01335a7f-8dbb-4dc8-8a35-6f8c09eb2cc0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.275149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1202/2372] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:59.279365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.289610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671911c-681b-4c2d-ae28-3eed97141c33 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.294188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.294835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.295118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.295458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] PATH_INFO: `/v3/projects/dfe8e585bdbe4803834f0536903e4a6c/users/fdb2eab96c564addb9a8de7400844f7d/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.309829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe8e585bdbe4803834f0536903e4a6c, user_id=fdb2eab96c564addb9a8de7400844f7d, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.313004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.326149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1171/2373] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:28:59 2022] PUT /identity/v3/projects/dfe8e585bdbe4803834f0536903e4a6c/users/fdb2eab96c564addb9a8de7400844f7d/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:59.337949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.338271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.338550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.365960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] MFA Rules not processed for user `fdb2eab96c564addb9a8de7400844f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:59.367183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:59.433828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1203/2374] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:59.438902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.503028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf06c34-651a-429d-8b32-fc4294986ffb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.508095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.508643 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.508926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.509237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.509898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.511784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.541253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1172/2375] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:59.545189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.557966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408238c-d4c1-42c9-b459-ecdea41d4fc7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.628742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.629612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.629704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.629984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.630643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.632591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.667911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1204/2376] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:59.669529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.681789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f643d97-f65a-4f54-b72a-63888584fcfa admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.688149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.688648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.688926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.689294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.690027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.691602 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.705150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1173/2377] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:59.711148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.722898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7eff-479e-466c-9185-05b1b1358a77 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.728169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1b646-dfd6-4e4d-be26-ae0718762dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.728810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1b646-dfd6-4e4d-be26-ae0718762dba admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.729304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1b646-dfd6-4e4d-be26-ae0718762dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.729619 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1b646-dfd6-4e4d-be26-ae0718762dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.731487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1b646-dfd6-4e4d-be26-ae0718762dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.731843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1b646-dfd6-4e4d-be26-ae0718762dba admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.743754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1205/2378] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:28:59.747975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.760666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecf324-5399-496a-b86a-bd5642d4df96 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.766906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.767893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.768179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.768460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] PATH_INFO: `/v3/projects/79c957052a9b4e75ba73f546f92fa1a1/users/096d647c532d4489a85ecf1a3c101ab4/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.785597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c957052a9b4e75ba73f546f92fa1a1, user_id=096d647c532d4489a85ecf1a3c101ab4, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.788237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.802077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1174/2379] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:28:59 2022] PUT /identity/v3/projects/79c957052a9b4e75ba73f546f92fa1a1/users/096d647c532d4489a85ecf1a3c101ab4/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:28:59.812364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.812744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.813143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.841030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] MFA Rules not processed for user `096d647c532d4489a85ecf1a3c101ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:59.842280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:59.882502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.910003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1206/2380] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:28:59.914766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.920373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.977928 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f150f0f-441e-48ee-94b9-c02826143865 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.982510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.983108 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.983430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.984364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.984990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.986983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.017606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1175/2381] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:00.019999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.032932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc96a2b-333b-4924-8b5c-5af365b971e0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.095784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.096393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.096675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.096952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.097623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.099574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.120569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1207/2382] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:00 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:00.125297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.135524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55306d-9f6d-47d0-a231-f2ebb6c7ac24 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.140789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.141442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.141720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.141993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.142632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.144227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.154840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1176/2383] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:29:00.158924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.169541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14e69-7f20-49f6-b809-02242ee7a5aa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.174316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.174966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.175249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.175528 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] PATH_INFO: `/v3/projects/f933a4fb88974cde8b40c5d576937ae8/users/1bf166f29e1a4860a523022c07cb3f3c/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.190453 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f933a4fb88974cde8b40c5d576937ae8, user_id=1bf166f29e1a4860a523022c07cb3f3c, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.193132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.206115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1208/2384] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:00 2022] PUT /identity/v3/projects/f933a4fb88974cde8b40c5d576937ae8/users/1bf166f29e1a4860a523022c07cb3f3c/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:00.210241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.220271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464826b-c691-4686-a007-1c47f0335811 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.275472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0172d-b593-436d-8cf6-b4db2eecf635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.276010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0172d-b593-436d-8cf6-b4db2eecf635 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.276290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0172d-b593-436d-8cf6-b4db2eecf635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.276567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0172d-b593-436d-8cf6-b4db2eecf635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.277240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0172d-b593-436d-8cf6-b4db2eecf635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.278855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0172d-b593-436d-8cf6-b4db2eecf635 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.288872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1177/2385] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:00.292947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.304104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871f74a-17f5-43cd-bece-d6e24dad3bcf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.308725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.309404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.309684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.309960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] PATH_INFO: `/v3/projects/f933a4fb88974cde8b40c5d576937ae8/users/1bf166f29e1a4860a523022c07cb3f3c/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.312542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f933a4fb88974cde8b40c5d576937ae8, user_id=1bf166f29e1a4860a523022c07cb3f3c, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.315392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.325472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1209/2386] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:00 2022] PUT /identity/v3/projects/f933a4fb88974cde8b40c5d576937ae8/users/1bf166f29e1a4860a523022c07cb3f3c/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:00.336707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.336989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.337298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.365482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] MFA Rules not processed for user `1bf166f29e1a4860a523022c07cb3f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:00.366686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:00.431168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.435110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1178/2387] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:00.452010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.453853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:00.510610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a019c6-827b-45b3-883f-6eaf3978362c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.514217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.514819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.515091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.515507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.524187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.525714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.534977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1210/2388] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:01.051291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.065730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909342e-e35d-47c3-b217-66d45e8f3449 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.069430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.070033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.070306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.070572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.130954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.132397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.141977 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1179/2389] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:05.196629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:05.198127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:05.209602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d44102-5269-46b6-a7e1-e52705f6f5d3 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:05.213155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f62242-1793-4319-adc5-eb7069ff5282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:05.213757 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f62242-1793-4319-adc5-eb7069ff5282 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.214037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f62242-1793-4319-adc5-eb7069ff5282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.214310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f62242-1793-4319-adc5-eb7069ff5282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.245282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:05.271606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f62242-1793-4319-adc5-eb7069ff5282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:05.273049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f62242-1793-4319-adc5-eb7069ff5282 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:05.282451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1211/2390] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:07.359417 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.421179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77304764-37a3-48ec-b021-89d83d4c0d00 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.426521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.427410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.427812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.428250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] PATH_INFO: `/v3/users/fdb2eab96c564addb9a8de7400844f7d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.429985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb2eab96c564addb9a8de7400844f7d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.432734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.479880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb2eab96c564addb9a8de7400844f7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:07.480537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb2eab96c564addb9a8de7400844f7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:07.487451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb2eab96c564addb9a8de7400844f7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:07.499865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb2eab96c564addb9a8de7400844f7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:07.500501 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb2eab96c564addb9a8de7400844f7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:07.512435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1180/2391] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:07 2022] DELETE /identity/v3/users/fdb2eab96c564addb9a8de7400844f7d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:07.517659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.518117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.518212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.536936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:07.538235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:07.596454 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1212/2392] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:07.606019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.607424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:07.627911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.668170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f83973-9d76-406d-8e5a-191632f2a892 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.672027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.672574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.672855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.673153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.682012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.683444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.693287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1181/2393] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:07.960428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.961881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:07.974442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9247e2-3181-4560-87cf-190766ae62c0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.978988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.979618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.979896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.980198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] PATH_INFO: `/v3/projects/dfe8e585bdbe4803834f0536903e4a6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.981324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe8e585bdbe4803834f0536903e4a6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.983907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.029591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe8e585bdbe4803834f0536903e4a6c', 'request_id': 'req-d709bd51-f682-4601-affc-0dcd358b700b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.035869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe8e585bdbe4803834f0536903e4a6c', 'request_id': 'req-d709bd51-f682-4601-affc-0dcd358b700b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.042936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe8e585bdbe4803834f0536903e4a6c', 'request_id': 'req-d709bd51-f682-4601-affc-0dcd358b700b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.054480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] The token cache is being invalidate because project dfe8e585bdbe4803834f0536903e4a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:08.054766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.055423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.056871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1213/2394] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:07 2022] DELETE /identity/v3/projects/dfe8e585bdbe4803834f0536903e4a6c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:08.061001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.071131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69690-79b5-49f5-a4e2-71a1dbc0d7cf service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.132131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.132764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.133042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.133342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] PATH_INFO: `/v3/users/096d647c532d4489a85ecf1a3c101ab4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.134446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096d647c532d4489a85ecf1a3c101ab4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.136379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.183819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096d647c532d4489a85ecf1a3c101ab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.184480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096d647c532d4489a85ecf1a3c101ab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.192725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096d647c532d4489a85ecf1a3c101ab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.210637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096d647c532d4489a85ecf1a3c101ab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.211291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096d647c532d4489a85ecf1a3c101ab4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.225696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1182/2395] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:08 2022] DELETE /identity/v3/users/096d647c532d4489a85ecf1a3c101ab4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:08.507157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.508665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:08.522564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709bd51-f682-4601-affc-0dcd358b700b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.581044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.591652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.592354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.592636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.592910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] PATH_INFO: `/v3/projects/79c957052a9b4e75ba73f546f92fa1a1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.594208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c957052a9b4e75ba73f546f92fa1a1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.596119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.643247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c957052a9b4e75ba73f546f92fa1a1', 'request_id': 'req-c5c1151c-b846-4738-8845-5248d04c0553'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.648462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c957052a9b4e75ba73f546f92fa1a1', 'request_id': 'req-c5c1151c-b846-4738-8845-5248d04c0553'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.655896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c957052a9b4e75ba73f546f92fa1a1', 'request_id': 'req-c5c1151c-b846-4738-8845-5248d04c0553'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.667132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] The token cache is being invalidate because project 79c957052a9b4e75ba73f546f92fa1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:08.667426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.668054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.669581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1214/2396] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:08 2022] DELETE /identity/v3/projects/79c957052a9b4e75ba73f546f92fa1a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:29:08.674132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.675568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:08.688652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f97a8f-d765-41b0-8b06-9049af021d18 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.725887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.745942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.746578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.746861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.747144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] PATH_INFO: `/v3/users/1bf166f29e1a4860a523022c07cb3f3c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.748263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf166f29e1a4860a523022c07cb3f3c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.750375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.794926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf166f29e1a4860a523022c07cb3f3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.795560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf166f29e1a4860a523022c07cb3f3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.803475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf166f29e1a4860a523022c07cb3f3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.815922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf166f29e1a4860a523022c07cb3f3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.816566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f6c158cb-0993-47b8-8314-5a49ebe6c191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf166f29e1a4860a523022c07cb3f3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:08.828652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1183/2397] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:08 2022] DELETE /identity/v3/users/1bf166f29e1a4860a523022c07cb3f3c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:09.094482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.095989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:09.109024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1151c-b846-4738-8845-5248d04c0553 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.168711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.169433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.169717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.169992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] PATH_INFO: `/v3/projects/f933a4fb88974cde8b40c5d576937ae8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.171739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f933a4fb88974cde8b40c5d576937ae8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.173710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.220375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f933a4fb88974cde8b40c5d576937ae8', 'request_id': 'req-063e01ef-0e57-487f-88c4-9cb7c42183dd'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:09.225723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f933a4fb88974cde8b40c5d576937ae8', 'request_id': 'req-063e01ef-0e57-487f-88c4-9cb7c42183dd'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:09.232898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f933a4fb88974cde8b40c5d576937ae8', 'request_id': 'req-063e01ef-0e57-487f-88c4-9cb7c42183dd'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:09.244482 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] The token cache is being invalidate because project f933a4fb88974cde8b40c5d576937ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:09.244772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:09.245420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-063e01ef-0e57-487f-88c4-9cb7c42183dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:09.247110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1215/2398] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:09 2022] DELETE /identity/v3/projects/f933a4fb88974cde8b40c5d576937ae8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:09.253129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.253426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.253705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.273971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:09.275181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:09.336474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1184/2399] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:09.345204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.345497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.345776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.365997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:09.367226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:09.375579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1216/2400] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:09.380060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.390238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344fdaf-80f3-4dfb-9e40-084d532934dd None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.395048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.395660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.395920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.396187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.396833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:09.397190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.398844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.411031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1185/2401] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:09.415731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.425649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15144d-285b-45a4-b87c-2d42ae231a04 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.430753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.431360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.431646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.431923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.432569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.434505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.440993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:09.468439 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1217/2402] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:09.469422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.479456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3489e37-867d-43b0-9c9d-9cb36e91b20c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.524918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:09.540149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.540757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.541038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.541341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.542003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.543920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.565750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1186/2403] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:09.570183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.580330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95477607-5f0f-44be-b07d-09380325f7ee admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.584951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.585608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.585892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.586166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.586808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.588395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.598441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1218/2404] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:09.602391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.612825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905b108-64b7-43fd-bb3f-1fae70facf3e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.617523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0149e2-e74c-43a9-8573-876fc3b70337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.618130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0149e2-e74c-43a9-8573-876fc3b70337 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.618412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0149e2-e74c-43a9-8573-876fc3b70337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.618689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0149e2-e74c-43a9-8573-876fc3b70337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.619335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0149e2-e74c-43a9-8573-876fc3b70337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.620932 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0149e2-e74c-43a9-8573-876fc3b70337 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.631848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1187/2405] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:09.636066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.646698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef560d-65b5-4436-a490-ada53eb6c05b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.651278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5297-723f-4478-a014-601c307be079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.651922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5297-723f-4478-a014-601c307be079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.652251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5297-723f-4478-a014-601c307be079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.652458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5297-723f-4478-a014-601c307be079 admin admin] PATH_INFO: `/v3/projects/97c9faa8e6524beb8313cde031c3d73f/users/dc156d450a504fc08d4eca0efdbb9e1c/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.667932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5297-723f-4478-a014-601c307be079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c9faa8e6524beb8313cde031c3d73f, user_id=dc156d450a504fc08d4eca0efdbb9e1c, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.670660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5297-723f-4478-a014-601c307be079 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.683480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1219/2406] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:09 2022] PUT /identity/v3/projects/97c9faa8e6524beb8313cde031c3d73f/users/dc156d450a504fc08d4eca0efdbb9e1c/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:09.695102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.695581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.695685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.723593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] MFA Rules not processed for user `dc156d450a504fc08d4eca0efdbb9e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:09.724782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:09.787137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1188/2407] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:09.791882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5297-723f-4478-a014-601c307be079 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.852520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5297-723f-4478-a014-601c307be079 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.857041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.857659 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.857942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.858214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.858871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.860791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.886872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1220/2408] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:09.891637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.902031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6a2b2-378b-411f-a548-f04528011671 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.958265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.958872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.959153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.959449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.960067 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.962039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.982807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1189/2409] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:09 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:09.986833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.996968 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba80097-bbf8-4b2a-bf6d-1b1f9f86f2de admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.002328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.002921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.003199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.003471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.004104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.005729 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.016524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1221/2410] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:29:10.020355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.030235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e574370-e595-472f-ae53-9088cf82a604 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.037042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e742e-adf4-4d47-8cee-da8eaa3be265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.037717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e742e-adf4-4d47-8cee-da8eaa3be265 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.037949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e742e-adf4-4d47-8cee-da8eaa3be265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.038223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e742e-adf4-4d47-8cee-da8eaa3be265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.039123 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e742e-adf4-4d47-8cee-da8eaa3be265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.040745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e742e-adf4-4d47-8cee-da8eaa3be265 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.051104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1190/2411] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:10.055096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.065590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ea39-7dd6-4265-bcc6-8bfbdbc9840f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.070233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.070956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.071235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.071513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] PATH_INFO: `/v3/projects/66a396e8dc734261902b543568e29e37/users/9332ac20f61c4c44ad05df5ad6e6c56e/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.086021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a396e8dc734261902b543568e29e37, user_id=9332ac20f61c4c44ad05df5ad6e6c56e, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.088689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.101000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1222/2412] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:10 2022] PUT /identity/v3/projects/66a396e8dc734261902b543568e29e37/users/9332ac20f61c4c44ad05df5ad6e6c56e/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:10.112552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.112850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.113135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.142222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] MFA Rules not processed for user `9332ac20f61c4c44ad05df5ad6e6c56e`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:10.143443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.162939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:10.208894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1191/2413] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:10.213396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.274344 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3c1a-09a1-48c9-b4ba-aa271abe7b2b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.278920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.279512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.279790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.280060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.280695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.282632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.287797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:10.310569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1223/2414] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:10.315639 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.326226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d02350-fe87-4c9a-abb8-2a5df7a76441 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.382618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.383221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.383499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.383791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.384410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.386338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.407487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1192/2415] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:10.411467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.422704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86762f9-7665-4018-8c95-782e6c29c072 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.427378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.427974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.428259 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.428537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.429249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.430848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.441401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1224/2416] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:10.445479 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.455135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac417-5384-4ba2-a0ee-7eea199b83a1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.459675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.460310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.460591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.460860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] PATH_INFO: `/v3/projects/a4fd7762c0344617ab8a2762b7b64876/users/cfe8b5e9497f444dab09b66957b0a5e2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.477580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fd7762c0344617ab8a2762b7b64876, user_id=cfe8b5e9497f444dab09b66957b0a5e2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.480200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.494716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1193/2417] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:10 2022] PUT /identity/v3/projects/a4fd7762c0344617ab8a2762b7b64876/users/cfe8b5e9497f444dab09b66957b0a5e2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:10.498735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.508828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a4e1f-9b79-443a-81f4-a211ce500928 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.565862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58b335-7ba8-4dcc-9e3f-a289b544c962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.566505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58b335-7ba8-4dcc-9e3f-a289b544c962 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.566857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58b335-7ba8-4dcc-9e3f-a289b544c962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.567206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58b335-7ba8-4dcc-9e3f-a289b544c962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.567925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58b335-7ba8-4dcc-9e3f-a289b544c962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.569631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58b335-7ba8-4dcc-9e3f-a289b544c962 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.586792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1225/2418] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:10.591432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.602753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a160-80ab-44a7-8c97-1c9a754a38aa admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.607576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.608251 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.609103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.609924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] PATH_INFO: `/v3/projects/a4fd7762c0344617ab8a2762b7b64876/users/cfe8b5e9497f444dab09b66957b0a5e2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.611578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fd7762c0344617ab8a2762b7b64876, user_id=cfe8b5e9497f444dab09b66957b0a5e2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.614277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.626554 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1194/2419] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:10 2022] PUT /identity/v3/projects/a4fd7762c0344617ab8a2762b7b64876/users/cfe8b5e9497f444dab09b66957b0a5e2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:10.636940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8191-6677-4970-a260-bcffcafb997a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.637266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8191-6677-4970-a260-bcffcafb997a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.637544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8191-6677-4970-a260-bcffcafb997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.666234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-653e8191-6677-4970-a260-bcffcafb997a None None] MFA Rules not processed for user `cfe8b5e9497f444dab09b66957b0a5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:10.667433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-653e8191-6677-4970-a260-bcffcafb997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.734356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1226/2420] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:10.746074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.747843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.804398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae3436-4b93-4fa6-8aa8-0986e4d9d8cc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.807942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358718-d000-4080-a006-bb7833092729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.808531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358718-d000-4080-a006-bb7833092729 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.808802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358718-d000-4080-a006-bb7833092729 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.809071 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38358718-d000-4080-a006-bb7833092729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.818494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38358718-d000-4080-a006-bb7833092729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.819848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38358718-d000-4080-a006-bb7833092729 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.829321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1195/2421] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:10.870881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8191-6677-4970-a260-bcffcafb997a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.872421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-653e8191-6677-4970-a260-bcffcafb997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.884908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8191-6677-4970-a260-bcffcafb997a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.888563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffa032-0787-4637-9373-fed58fe80969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.889185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffa032-0787-4637-9373-fed58fe80969 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.889481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffa032-0787-4637-9373-fed58fe80969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.889846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffa032-0787-4637-9373-fed58fe80969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.944842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:10.947325 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffa032-0787-4637-9373-fed58fe80969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.949089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffa032-0787-4637-9373-fed58fe80969 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.959218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1227/2422] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:13.835452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358718-d000-4080-a006-bb7833092729 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.853837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.897839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38358718-d000-4080-a006-bb7833092729 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.902284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.902901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.903176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.903544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] PATH_INFO: `/v3/users/dc156d450a504fc08d4eca0efdbb9e1c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.904637 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc156d450a504fc08d4eca0efdbb9e1c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.907119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.953018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc156d450a504fc08d4eca0efdbb9e1c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:13.953715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc156d450a504fc08d4eca0efdbb9e1c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:13.960689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc156d450a504fc08d4eca0efdbb9e1c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:13.973033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc156d450a504fc08d4eca0efdbb9e1c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:13.973702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc156d450a504fc08d4eca0efdbb9e1c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:13.985699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1196/2423] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:13 2022] DELETE /identity/v3/users/dc156d450a504fc08d4eca0efdbb9e1c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:13.990397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.990855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.990993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.135366 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:14.136626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:14.197629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1228/2424] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:14.208129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.209593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:14.265756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bff59a-2eb9-4cb2-a079-6b868f184f59 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.269272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.269872 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.270148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.270419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.279193 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.280665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.290073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1197/2425] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:14.558802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.560248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:14.574869 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4f43-68ba-492a-b84c-8a3f1fd6e34d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.580078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.580726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.581022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.581312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] PATH_INFO: `/v3/projects/97c9faa8e6524beb8313cde031c3d73f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.583000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c9faa8e6524beb8313cde031c3d73f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.585778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.632299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c9faa8e6524beb8313cde031c3d73f', 'request_id': 'req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.637816 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c9faa8e6524beb8313cde031c3d73f', 'request_id': 'req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.645725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c9faa8e6524beb8313cde031c3d73f', 'request_id': 'req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.657123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] The token cache is being invalidate because project 97c9faa8e6524beb8313cde031c3d73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:14.657426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.658059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.659531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1229/2426] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:14 2022] DELETE /identity/v3/projects/97c9faa8e6524beb8313cde031c3d73f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:14.663471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.673493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369c434-d4fa-4162-a306-415a5c288f4b service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.710920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:14.731811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.732438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.732718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.732994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] PATH_INFO: `/v3/users/9332ac20f61c4c44ad05df5ad6e6c56e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.734167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9332ac20f61c4c44ad05df5ad6e6c56e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.736088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.780745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9332ac20f61c4c44ad05df5ad6e6c56e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.781427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9332ac20f61c4c44ad05df5ad6e6c56e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.788468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9332ac20f61c4c44ad05df5ad6e6c56e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.801162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9332ac20f61c4c44ad05df5ad6e6c56e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.801855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9332ac20f61c4c44ad05df5ad6e6c56e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:14.814478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1198/2427] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:14 2022] DELETE /identity/v3/users/9332ac20f61c4c44ad05df5ad6e6c56e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:15.089601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:15.091027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:15.104750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c66b7-ad61-46f2-8e5c-0a04d5273d43 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:15.161092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:15.161758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.162041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.162316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] PATH_INFO: `/v3/projects/66a396e8dc734261902b543568e29e37` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.163425 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a396e8dc734261902b543568e29e37)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:15.165650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:15.187984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:15.213488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a396e8dc734261902b543568e29e37', 'request_id': 'req-b044c1f2-d864-4385-a8e8-daef8678fbed'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.219703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a396e8dc734261902b543568e29e37', 'request_id': 'req-b044c1f2-d864-4385-a8e8-daef8678fbed'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.226916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a396e8dc734261902b543568e29e37', 'request_id': 'req-b044c1f2-d864-4385-a8e8-daef8678fbed'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.238846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] The token cache is being invalidate because project 66a396e8dc734261902b543568e29e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:15.239144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.239791 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.241343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1230/2428] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:15 2022] DELETE /identity/v3/projects/66a396e8dc734261902b543568e29e37 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:15.245314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:15.246713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:15.265799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f929a8-944a-456e-8a1d-573bc11dceca admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:15.325723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:15.326369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.326646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.326937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] PATH_INFO: `/v3/users/cfe8b5e9497f444dab09b66957b0a5e2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.328533 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe8b5e9497f444dab09b66957b0a5e2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:15.330854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:15.380202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe8b5e9497f444dab09b66957b0a5e2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.380853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe8b5e9497f444dab09b66957b0a5e2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.388235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe8b5e9497f444dab09b66957b0a5e2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.393955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:15.402673 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe8b5e9497f444dab09b66957b0a5e2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.403427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ddcf2da1-c89d-4d6f-8595-f9a2f608d3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe8b5e9497f444dab09b66957b0a5e2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.415889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1199/2429] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:15 2022] DELETE /identity/v3/users/cfe8b5e9497f444dab09b66957b0a5e2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:15.704939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:15.706739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:15.720411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044c1f2-d864-4385-a8e8-daef8678fbed admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:15.777261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:15.777905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.778187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.778467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] PATH_INFO: `/v3/projects/a4fd7762c0344617ab8a2762b7b64876` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.779581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fd7762c0344617ab8a2762b7b64876)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:15.781574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:15.827644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fd7762c0344617ab8a2762b7b64876', 'request_id': 'req-c10e4478-e3a2-4859-a048-f60afecf802b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.833322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fd7762c0344617ab8a2762b7b64876', 'request_id': 'req-c10e4478-e3a2-4859-a048-f60afecf802b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.840350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fd7762c0344617ab8a2762b7b64876', 'request_id': 'req-c10e4478-e3a2-4859-a048-f60afecf802b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.851075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] The token cache is being invalidate because project a4fd7762c0344617ab8a2762b7b64876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:15.851363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.851983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c10e4478-e3a2-4859-a048-f60afecf802b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:15.853478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1231/2430] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:15 2022] DELETE /identity/v3/projects/a4fd7762c0344617ab8a2762b7b64876 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:15.859610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.859893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.860167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.880657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:15.881799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:15.939705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1200/2431] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:15.949375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.949670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.949951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.972747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:15.973978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:15.981824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1232/2432] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:15.986788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:15.996466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01ae66-66c0-40b1-bdf1-350d6401616e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.001236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.001830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.002111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.002385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.003023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:16.003324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.004915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.016759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1201/2433] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:16.021155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.030023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a1e7b-1d19-4746-a2f8-ef62d9120541 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.035394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.035983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.036260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.036532 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.037196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.039343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.066336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1233/2434] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:16.070640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.081293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977cd06-890a-40bd-8e5d-186825db2c91 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.138898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.140077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.140414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.140789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.141446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.143353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.165590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1202/2435] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:16.169867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.180679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058dc6-6196-4569-8b25-56ee16627274 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.185251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.185846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.186129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.186448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.187092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.188687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.193759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.199409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1234/2436] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:16.203619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.213883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb7200-5cbb-4c07-8f6b-8fbf8e5a4648 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.219537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e712e2b-9608-412b-b97a-36de4bccf0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.220147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e712e2b-9608-412b-b97a-36de4bccf0af admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.220431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e712e2b-9608-412b-b97a-36de4bccf0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.220706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e712e2b-9608-412b-b97a-36de4bccf0af admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.221388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e712e2b-9608-412b-b97a-36de4bccf0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.222997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e712e2b-9608-412b-b97a-36de4bccf0af admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.234566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1203/2437] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:29:16.238831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.248604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8fa69-bc04-46f7-bb5f-7ab6787a815e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.253844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.254492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.254775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.255051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] PATH_INFO: `/v3/projects/395b0ddef03b4c97a7eff7569ea32724/users/2e657dbb0ffb425e8d0d7f45085b96bb/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.269984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395b0ddef03b4c97a7eff7569ea32724, user_id=2e657dbb0ffb425e8d0d7f45085b96bb, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.272645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.285996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1235/2438] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:16 2022] PUT /identity/v3/projects/395b0ddef03b4c97a7eff7569ea32724/users/2e657dbb0ffb425e8d0d7f45085b96bb/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:16.297985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.298500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.298500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.327379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] MFA Rules not processed for user `2e657dbb0ffb425e8d0d7f45085b96bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:16.328581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:16.364539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.399471 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1204/2439] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:16.403958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.467889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4302-05b8-4cc2-b1ae-b70050c4c004 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.472622 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.473271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.473556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.473835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.474498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.476517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.504469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1236/2440] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:16.508322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.519638 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f07652-2315-4478-a7c3-cbb7f25564e6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.578257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.579020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.579302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.579577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.580239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.582198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.603185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1205/2441] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:16.607113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.617977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3868-b30a-4a63-b082-0acd5635e27e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.623644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.624276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.624560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.625443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.625557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.627110 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.637698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1237/2442] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:16.641914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.651814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff2336-7da4-4c4a-b736-bf46ff83b8b5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.656949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.657633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.657908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.658181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] PATH_INFO: `/v3/projects/73effb8415004d29b1701f47dd46e4a5/users/b4dce6e68a8249888d54efc0745204d2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.673527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73effb8415004d29b1701f47dd46e4a5, user_id=b4dce6e68a8249888d54efc0745204d2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.676153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.688340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1206/2443] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:16 2022] PUT /identity/v3/projects/73effb8415004d29b1701f47dd46e4a5/users/b4dce6e68a8249888d54efc0745204d2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:16.692385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.702101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed7b38-20d9-473f-bfc9-02a424420b00 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.757146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d83b10-5cc7-4fac-b928-3a96ad5fd0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.757750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d83b10-5cc7-4fac-b928-3a96ad5fd0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.758026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d83b10-5cc7-4fac-b928-3a96ad5fd0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.758295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d83b10-5cc7-4fac-b928-3a96ad5fd0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.758923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d83b10-5cc7-4fac-b928-3a96ad5fd0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.760489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d83b10-5cc7-4fac-b928-3a96ad5fd0d4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.770772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1238/2444] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:16.775191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.785885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb59341-9a75-4d6a-9abb-e555091b6426 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.790751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.791392 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.791667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.792542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] PATH_INFO: `/v3/projects/73effb8415004d29b1701f47dd46e4a5/users/b4dce6e68a8249888d54efc0745204d2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.794492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73effb8415004d29b1701f47dd46e4a5, user_id=b4dce6e68a8249888d54efc0745204d2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.797957 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.807877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1207/2445] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:16 2022] PUT /identity/v3/projects/73effb8415004d29b1701f47dd46e4a5/users/b4dce6e68a8249888d54efc0745204d2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:16.818577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85824-5027-451c-a879-62be341ec941 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.818857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85824-5027-451c-a879-62be341ec941 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.819126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d85824-5027-451c-a879-62be341ec941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.846151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-31d85824-5027-451c-a879-62be341ec941 None None] MFA Rules not processed for user `b4dce6e68a8249888d54efc0745204d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:16.847399 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-31d85824-5027-451c-a879-62be341ec941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:16.880668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.915247 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1239/2446] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:16.926415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.928171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:16.985927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f940e-0328-4962-8653-5da3c91670f1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.989569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8c961-2596-4def-a3b2-d398c3e61b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.990166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c961-2596-4def-a3b2-d398c3e61b1e service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.990474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c961-2596-4def-a3b2-d398c3e61b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.990751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8c961-2596-4def-a3b2-d398c3e61b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.030430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.048027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8c961-2596-4def-a3b2-d398c3e61b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.049510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8c961-2596-4def-a3b2-d398c3e61b1e service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.058207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1208/2447] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:21.287936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d85824-5027-451c-a879-62be341ec941 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.289796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-31d85824-5027-451c-a879-62be341ec941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:21.303205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d85824-5027-451c-a879-62be341ec941 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.307136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.307761 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.308037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.308309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.318742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.320214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.330575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1240/2448] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:25.934968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:25.935873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:25.936297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:25.956612 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:25.957921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:26.013987 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1209/2449] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:29:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:26.062665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.064114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:26.133355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb5fb7-bbf1-4bf1-a155-3a3ec0a146f4 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.138226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da7cd0-d4df-4a15-8f6b-f3159979ba45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.138826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7cd0-d4df-4a15-8f6b-f3159979ba45 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.139625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7cd0-d4df-4a15-8f6b-f3159979ba45 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.140044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7cd0-d4df-4a15-8f6b-f3159979ba45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.148753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7cd0-d4df-4a15-8f6b-f3159979ba45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.150352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7cd0-d4df-4a15-8f6b-f3159979ba45 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.159114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1241/2450] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:29:26.227503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.316797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f570937-874e-4b94-a94f-ef1dc9573f97 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.321922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.322650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.323009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.323362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] PATH_INFO: `/v3/users/2e657dbb0ffb425e8d0d7f45085b96bb` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.324585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e657dbb0ffb425e8d0d7f45085b96bb)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.327377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.398651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e657dbb0ffb425e8d0d7f45085b96bb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:26.399979 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e657dbb0ffb425e8d0d7f45085b96bb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:26.410188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e657dbb0ffb425e8d0d7f45085b96bb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:26.449658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e657dbb0ffb425e8d0d7f45085b96bb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:26.450590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e657dbb0ffb425e8d0d7f45085b96bb'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:26.478902 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1210/2451] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:26 2022] DELETE /identity/v3/users/2e657dbb0ffb425e8d0d7f45085b96bb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:26.483895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.484246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.484522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.530681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:26.532362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:26.649190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1242/2452] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:26.656631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.658095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:26.665267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:26.740652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a53a-5b8f-4c90-800b-737318eef106 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.745691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.746513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.747047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.747378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.760594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.763429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.779130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1211/2453] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:27.354026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.357286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:27.371213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbd57-63dc-4cd1-bb0d-b54394aacc4a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.393792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.394808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.395525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.396098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] PATH_INFO: `/v3/projects/395b0ddef03b4c97a7eff7569ea32724` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.397205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395b0ddef03b4c97a7eff7569ea32724)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.399281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.473603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:27.480447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395b0ddef03b4c97a7eff7569ea32724', 'request_id': 'req-3d8aa2fc-2752-46bf-b0fe-01d14a921296'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.488468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395b0ddef03b4c97a7eff7569ea32724', 'request_id': 'req-3d8aa2fc-2752-46bf-b0fe-01d14a921296'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.498337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395b0ddef03b4c97a7eff7569ea32724', 'request_id': 'req-3d8aa2fc-2752-46bf-b0fe-01d14a921296'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.515155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] The token cache is being invalidate because project 395b0ddef03b4c97a7eff7569ea32724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:27.515155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.516556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.521095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1243/2454] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:27 2022] DELETE /identity/v3/projects/395b0ddef03b4c97a7eff7569ea32724 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:27.522363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.533019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f880-15ff-4376-972d-04b81c9ef28b service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.615723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.616538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.616836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.617088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] PATH_INFO: `/v3/users/b4dce6e68a8249888d54efc0745204d2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.623223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dce6e68a8249888d54efc0745204d2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.626064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.692247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dce6e68a8249888d54efc0745204d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.693188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dce6e68a8249888d54efc0745204d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.705865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dce6e68a8249888d54efc0745204d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.720771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dce6e68a8249888d54efc0745204d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.721679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e2df3153-04f1-43d9-a497-a8589477ddb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dce6e68a8249888d54efc0745204d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:27.741083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1212/2455] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:27 2022] DELETE /identity/v3/users/b4dce6e68a8249888d54efc0745204d2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:28.118050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.119652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:28.165048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aa2fc-2752-46bf-b0fe-01d14a921296 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:28.269709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:28.270377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.270660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.270930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] PATH_INFO: `/v3/projects/73effb8415004d29b1701f47dd46e4a5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.272109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73effb8415004d29b1701f47dd46e4a5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:28.274183 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:28.366437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73effb8415004d29b1701f47dd46e4a5', 'request_id': 'req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:28.372929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73effb8415004d29b1701f47dd46e4a5', 'request_id': 'req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:28.384036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73effb8415004d29b1701f47dd46e4a5', 'request_id': 'req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:28.399278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] The token cache is being invalidate because project 73effb8415004d29b1701f47dd46e4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:28.399660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:28.400734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edf7283b-bcfe-4e41-83e0-029a5f9f8d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:28.404117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1244/2456] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:28 2022] DELETE /identity/v3/projects/73effb8415004d29b1701f47dd46e4a5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:28.415383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.416559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.416559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.444299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:28.445577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:28.534234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:28.613163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1213/2457] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:28.690539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.690901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.699434 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.720252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:28.721512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:28.730804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1245/2458] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:28.738788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.753617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143191fa-456a-4a65-b8e7-01a80247fb71 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:28.759284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:28.760628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.761147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.761831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.762494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:28.762805 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:28.765018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:28.784850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1214/2459] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:28.790006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.802209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d04d1a-4f03-4680-99aa-fd84fe3ae631 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:28.808224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:28.808913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.809313 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.809665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.810379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:28.812692 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:28.850624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1246/2460] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:28.858663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.875502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea5e9d-60ae-49fb-8ce7-af3e709d672d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:28.947918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:28.948694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.948988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.951164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.951164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:28.952747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:28.981779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1215/2461] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:28.986145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.998693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a97341-4b6c-4657-949c-cac6a7fae74c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:29.005198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:29.006280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.006672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.006955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.007860 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:29.011201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:29.027161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1247/2462] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:29.028407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:29.040202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe0832-f20b-4ead-b549-6efb856cec04 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:29.045177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd26258-12a8-490f-960c-fbc1041fa6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:29.045960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd26258-12a8-490f-960c-fbc1041fa6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.046347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd26258-12a8-490f-960c-fbc1041fa6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.046723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd26258-12a8-490f-960c-fbc1041fa6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.047474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd26258-12a8-490f-960c-fbc1041fa6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:29.049206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd26258-12a8-490f-960c-fbc1041fa6dc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:29.064460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1216/2463] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:29.065698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:29.076320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66a118-b8e0-4ac6-b841-e06d97090481 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:29.084557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:29.085712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.086305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.086724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] PATH_INFO: `/v3/projects/7b86c807acb5460f9163183e96a920c2/users/7a01f5fef19d49c69e051dbc70eeba7d/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.113371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b86c807acb5460f9163183e96a920c2, user_id=7a01f5fef19d49c69e051dbc70eeba7d, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:29.116118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:29.126617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:29.135047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1248/2464] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:29 2022] PUT /identity/v3/projects/7b86c807acb5460f9163183e96a920c2/users/7a01f5fef19d49c69e051dbc70eeba7d/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:29:29.147576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.147908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.148167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.181684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] MFA Rules not processed for user `7a01f5fef19d49c69e051dbc70eeba7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:29.183025 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:29.259771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1217/2465] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:29.272249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:29.274305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:29.342632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d2c5-e04b-49a4-a41f-f48ad0a88bc3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:29.347008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ade346-8b99-422e-9b8a-a433fa88ddc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:29.347621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ade346-8b99-422e-9b8a-a433fa88ddc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.347907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ade346-8b99-422e-9b8a-a433fa88ddc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.348186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ade346-8b99-422e-9b8a-a433fa88ddc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.358700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ade346-8b99-422e-9b8a-a433fa88ddc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:29.359605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ade346-8b99-422e-9b8a-a433fa88ddc5 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:29.370683 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1249/2466] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:39.256795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:39.365942 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=27 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:41.334710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:41.398667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf9d8b-ff45-4d48-b7a4-5097cbd86958 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:41.403435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:41.404075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.405062 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.405494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] PATH_INFO: `/v3/users/7a01f5fef19d49c69e051dbc70eeba7d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.406786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a01f5fef19d49c69e051dbc70eeba7d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:41.408722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:41.457277 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a01f5fef19d49c69e051dbc70eeba7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:41.457941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a01f5fef19d49c69e051dbc70eeba7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:41.465761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a01f5fef19d49c69e051dbc70eeba7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:41.479228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a01f5fef19d49c69e051dbc70eeba7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:41.479930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a01f5fef19d49c69e051dbc70eeba7d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:41.494127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1218/2467] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:41 2022] DELETE /identity/v3/users/7a01f5fef19d49c69e051dbc70eeba7d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:41.499341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.499837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.499960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.519216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:41.520427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:41.579350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1250/2468] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:41.589698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:41.591231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:41.663241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce12fb9-8ba9-4ecb-b79b-efe3e263f2c9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:41.667750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c72b1-e8e0-4153-92d8-351aa7d8d55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:41.667882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c72b1-e8e0-4153-92d8-351aa7d8d55f service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.668154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c72b1-e8e0-4153-92d8-351aa7d8d55f service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.668438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c72b1-e8e0-4153-92d8-351aa7d8d55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.679284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c72b1-e8e0-4153-92d8-351aa7d8d55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:41.681002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c72b1-e8e0-4153-92d8-351aa7d8d55f service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:41.691159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1219/2469] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:42.093177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.094789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:42.106527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef439dd-1ae1-4436-9b9a-5a0da17cbbe5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.111588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.112249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.112531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.112798 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] PATH_INFO: `/v3/projects/7b86c807acb5460f9163183e96a920c2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.113953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b86c807acb5460f9163183e96a920c2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.115849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.182676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b86c807acb5460f9163183e96a920c2', 'request_id': 'req-d45afbe5-fce0-4e68-aa09-36d571af3925'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:42.197308 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b86c807acb5460f9163183e96a920c2', 'request_id': 'req-d45afbe5-fce0-4e68-aa09-36d571af3925'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:42.206314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b86c807acb5460f9163183e96a920c2', 'request_id': 'req-d45afbe5-fce0-4e68-aa09-36d571af3925'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:42.218702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] The token cache is being invalidate because project 7b86c807acb5460f9163183e96a920c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:42.219002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:42.219710 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d45afbe5-fce0-4e68-aa09-36d571af3925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:42.221790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1251/2470] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:42 2022] DELETE /identity/v3/projects/7b86c807acb5460f9163183e96a920c2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:42.226610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30efe-b679-4895-b82d-180ad020832d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.226895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30efe-b679-4895-b82d-180ad020832d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.227169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30efe-b679-4895-b82d-180ad020832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.247070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-70b30efe-b679-4895-b82d-180ad020832d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:42.248366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-70b30efe-b679-4895-b82d-180ad020832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:42.266373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.315089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1220/2471] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:42.324062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.324356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.324636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.345171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:42.346380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:42.354180 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1252/2472] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:42.359175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b30efe-b679-4895-b82d-180ad020832d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.368948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b30efe-b679-4895-b82d-180ad020832d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.374263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.374894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.375170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.375439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.376081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:42.376382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.378198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.394703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1221/2473] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:42.395776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.405863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8872e-1c73-4bbc-9866-4f2b02babed3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.410899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.411609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.412071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.412354 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.413098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.415260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.444678 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1253/2474] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:42 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:42.448906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.460408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d43de2-061a-4ddb-ab2e-9a406ddc4e80 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.517792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.518401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.518684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.518967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.519601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.521583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.542256 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1222/2475] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:42 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:42.547158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.557172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f963b-09ca-4dba-91e2-0c9ff1593a40 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.562347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.562944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.563224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.563498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.564138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.565769 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.575864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1254/2476] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:29:42.580063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.593978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f02f4-0b0d-49b3-b2ec-7f30859c5c73 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.598780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cec108-a985-48ae-9cfd-20ea4f2f8f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.599412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec108-a985-48ae-9cfd-20ea4f2f8f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.599697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec108-a985-48ae-9cfd-20ea4f2f8f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.599971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cec108-a985-48ae-9cfd-20ea4f2f8f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.600614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cec108-a985-48ae-9cfd-20ea4f2f8f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.602303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cec108-a985-48ae-9cfd-20ea4f2f8f49 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.613749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1223/2477] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:42.618031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.629287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfc0fb-c710-462a-bb2e-457dd4489590 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.633870 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.634519 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.634868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.635148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] PATH_INFO: `/v3/projects/5147d0cbc28c4ee4afec09b1525e706e/users/1a6ee2f8526744bc9b2e42c2acf6b653/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.650299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5147d0cbc28c4ee4afec09b1525e706e, user_id=1a6ee2f8526744bc9b2e42c2acf6b653, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.652905 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.666516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1255/2478] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:42 2022] PUT /identity/v3/projects/5147d0cbc28c4ee4afec09b1525e706e/users/1a6ee2f8526744bc9b2e42c2acf6b653/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:42.676884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.677150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.677425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.705590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] MFA Rules not processed for user `1a6ee2f8526744bc9b2e42c2acf6b653`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:42.706816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:42.770100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1224/2479] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:42.781430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.783133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:42.804898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.844563 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de03e-61e5-40d1-bf89-c2eec85e53aa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.848282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02eb76-93e0-4ba3-b7c4-60fb4ff443b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.848895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02eb76-93e0-4ba3-b7c4-60fb4ff443b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.849205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02eb76-93e0-4ba3-b7c4-60fb4ff443b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.849479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02eb76-93e0-4ba3-b7c4-60fb4ff443b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.858461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02eb76-93e0-4ba3-b7c4-60fb4ff443b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.859894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02eb76-93e0-4ba3-b7c4-60fb4ff443b9 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.868651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1256/2480] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:42.893800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.913604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.957191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c2987-a185-4bc7-90fd-8f8f8f4f11e3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.961718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.962347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.962629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.962906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] PATH_INFO: `/v3/users/1a6ee2f8526744bc9b2e42c2acf6b653` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.964064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6ee2f8526744bc9b2e42c2acf6b653)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.966010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.015204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6ee2f8526744bc9b2e42c2acf6b653'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.015877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6ee2f8526744bc9b2e42c2acf6b653'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.023704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6ee2f8526744bc9b2e42c2acf6b653'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.036797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6ee2f8526744bc9b2e42c2acf6b653'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.037522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6ee2f8526744bc9b2e42c2acf6b653'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.050010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1225/2481] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:29:42 2022] DELETE /identity/v3/users/1a6ee2f8526744bc9b2e42c2acf6b653 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:43.054505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.054792 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.055072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.075014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:43.076772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:43.181401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1257/2482] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:43.187885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.189602 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:43.284920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca42906-080f-471f-8979-2bde80223688 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.289789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d503c5-504e-4bc3-83c4-9d03815dcc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.290482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d503c5-504e-4bc3-83c4-9d03815dcc8d service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.290831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d503c5-504e-4bc3-83c4-9d03815dcc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.291169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d503c5-504e-4bc3-83c4-9d03815dcc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.304772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d503c5-504e-4bc3-83c4-9d03815dcc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.306429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d503c5-504e-4bc3-83c4-9d03815dcc8d service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.323082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1226/2483] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:43.690069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.691648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:43.710808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db081c-1384-4eab-b30a-8b54381260a8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.716340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.717591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.718060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.718617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] PATH_INFO: `/v3/projects/5147d0cbc28c4ee4afec09b1525e706e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.720035 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5147d0cbc28c4ee4afec09b1525e706e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.723809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.792995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5147d0cbc28c4ee4afec09b1525e706e', 'request_id': 'req-286a471b-5eec-4aae-9f96-c98e443d8b4c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.801933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5147d0cbc28c4ee4afec09b1525e706e', 'request_id': 'req-286a471b-5eec-4aae-9f96-c98e443d8b4c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.815949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5147d0cbc28c4ee4afec09b1525e706e', 'request_id': 'req-286a471b-5eec-4aae-9f96-c98e443d8b4c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.833289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] The token cache is being invalidate because project 5147d0cbc28c4ee4afec09b1525e706e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:29:43.833901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.835312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-286a471b-5eec-4aae-9f96-c98e443d8b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:29:43.840954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1258/2484] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:29:43 2022] DELETE /identity/v3/projects/5147d0cbc28c4ee4afec09b1525e706e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:43.843455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.845337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.845742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.868745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:43.870166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:43.915042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.945392 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1227/2485] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:43.954000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.954287 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.954564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.975257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:43.976422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:43.985302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1259/2486] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:43.989652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.001808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da93b2-91fe-4724-b3c6-3bca7664687e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.006683 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.007320 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.007591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.007881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.008535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:44.008848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.010498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.023164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1228/2487] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:44.027464 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.037061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d688643-5480-4774-aa14-9b2bccf0ca30 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.048522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.050059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.051279 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.051865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.052711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.054760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.091826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1260/2488] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:44 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:44.094195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.104429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0275d-3c81-4f76-aa77-c506d3122005 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.178578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.179208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.179645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.179931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.180569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.182686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.209883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1229/2489] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:44 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:44.214273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.226731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69153f-e47d-421c-9ad7-a8857342a321 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.231590 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.232196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.232711 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.232986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.233669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.235255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.250826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1261/2490] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:29:44.252194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.263826 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552cf3-ea43-4166-bf22-c17bbebce4fd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.269641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29063e86-d234-4e54-a8dc-943458a6f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.270466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29063e86-d234-4e54-a8dc-943458a6f228 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.270918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29063e86-d234-4e54-a8dc-943458a6f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.271049 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29063e86-d234-4e54-a8dc-943458a6f228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.271674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29063e86-d234-4e54-a8dc-943458a6f228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.274490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29063e86-d234-4e54-a8dc-943458a6f228 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.285978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1230/2491] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:44.290783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.304597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8470b-cb65-46ad-80e1-63ffffcfa3f2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.320525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b3373-5a1c-4dfc-afb0-e74474b25016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.321321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3373-5a1c-4dfc-afb0-e74474b25016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.324435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3373-5a1c-4dfc-afb0-e74474b25016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.324742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b3373-5a1c-4dfc-afb0-e74474b25016 admin admin] PATH_INFO: `/v3/projects/92430c091c8547389a0faf76628395c5/users/a1949b6903e44c20adc2af0f3f858b43/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.332489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:44.360589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b3373-5a1c-4dfc-afb0-e74474b25016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92430c091c8547389a0faf76628395c5, user_id=a1949b6903e44c20adc2af0f3f858b43, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.363501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b3373-5a1c-4dfc-afb0-e74474b25016 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.401828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.402412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.402793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.406581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1262/2492] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:44 2022] PUT /identity/v3/projects/92430c091c8547389a0faf76628395c5/users/a1949b6903e44c20adc2af0f3f858b43/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:44.434420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:44.436356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:44.584702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.585029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.585299 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.622225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1231/2493] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:44.627024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:44.627971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:44.636775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.640739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:44.714368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1263/2494] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:29:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:44.731097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:44.735367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:44.738066 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:44.750937 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7692d-5d4a-41f1-8678-9767acd21f14 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.755588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6790d-029d-4a62-bab0-3a184bba68d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.761247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6790d-029d-4a62-bab0-3a184bba68d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.762324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6790d-029d-4a62-bab0-3a184bba68d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.763385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6790d-029d-4a62-bab0-3a184bba68d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.780644 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6790d-029d-4a62-bab0-3a184bba68d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.782520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6790d-029d-4a62-bab0-3a184bba68d1 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.833135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1232/2495] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:44.843420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca096404-90d8-4e4a-ba35-a801d9cc556a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:44.849500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:44.850136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:44.850420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:44.850697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:44.859750 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:44.861411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:44.870509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1264/2496] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:29:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:29:51.175855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.176299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.176622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.259019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] MFA Rules not processed for user `a1949b6903e44c20adc2af0f3f858b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:51.260346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:51.347114 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1233/2497] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:51.351588 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.364875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfba637-f4c0-4f28-b866-aa4c74d8bf60 service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.369460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.370078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.370357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.370629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.371265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.373353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.406388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1265/2498] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:29:51 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:51.410468 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.431054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d40f2-8fd7-448c-aecb-b94e577f27db None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.508339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.508980 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.509287 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.509567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.510225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.512167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.542355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1234/2499] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:51 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:51.546972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.558177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f21c8b-62e9-44d9-9ee8-2b4a8f4e0cca admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.563746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.564469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.564814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.565184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.565835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.567442 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.581880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1266/2500] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:51.583216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.596199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d1da3-6c3a-43bb-8289-89c8fc1a7256 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.602311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.603008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.603291 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.603571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] PATH_INFO: `/v3/projects/1ffd05cf20374303b04f0681eb13ac8c/users/72c95043ea3c4d79925152b85cf43674/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.638135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffd05cf20374303b04f0681eb13ac8c, user_id=72c95043ea3c4d79925152b85cf43674, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.642031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.669509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1235/2501] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:51 2022] PUT /identity/v3/projects/1ffd05cf20374303b04f0681eb13ac8c/users/72c95043ea3c4d79925152b85cf43674/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:51.673736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.699635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157603c0-3989-4b1d-beef-e13f6d0c8640 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.788559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:51.824911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524db86-de0f-4873-a2cb-2f7a34212975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.825591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524db86-de0f-4873-a2cb-2f7a34212975 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.825876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524db86-de0f-4873-a2cb-2f7a34212975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.826730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524db86-de0f-4873-a2cb-2f7a34212975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.829205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524db86-de0f-4873-a2cb-2f7a34212975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.830865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524db86-de0f-4873-a2cb-2f7a34212975 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.849469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1267/2502] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:29:51.853899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.865946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21556cd-7538-4048-80af-0e1c043b7118 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.872249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.873609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.873901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.874181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] PATH_INFO: `/v3/projects/1ffd05cf20374303b04f0681eb13ac8c/users/72c95043ea3c4d79925152b85cf43674/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.876212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffd05cf20374303b04f0681eb13ac8c, user_id=72c95043ea3c4d79925152b85cf43674, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.878929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.894389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1236/2503] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:29:51 2022] PUT /identity/v3/projects/1ffd05cf20374303b04f0681eb13ac8c/users/72c95043ea3c4d79925152b85cf43674/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:57.480012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1d7f6-f0f7-4fc4-873a-1fcacc32cf01 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:57.480485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1d7f6-f0f7-4fc4-873a-1fcacc32cf01 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:57.480680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1d7f6-f0f7-4fc4-873a-1fcacc32cf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:57.508463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20a1d7f6-f0f7-4fc4-873a-1fcacc32cf01 None None] MFA Rules not processed for user `72c95043ea3c4d79925152b85cf43674`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:57.509724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20a1d7f6-f0f7-4fc4-873a-1fcacc32cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:57.581147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1268/2504] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:29:57.595432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:57.597137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:57.641947 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:57.685179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe70c-463c-4057-a030-f461bba30729 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:57.692119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:57.692820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:57.692994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:57.693295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:57.760312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:57.761981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:57.773851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1237/2505] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:29:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:29:59.137833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff956-c4f0-4fa9-8fe3-8760a1f414c9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:59.138387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff956-c4f0-4fa9-8fe3-8760a1f414c9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:59.138486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ff956-c4f0-4fa9-8fe3-8760a1f414c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:59.170417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f91ff956-c4f0-4fa9-8fe3-8760a1f414c9 None None] MFA Rules not processed for user `a1949b6903e44c20adc2af0f3f858b43`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:59.170417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f91ff956-c4f0-4fa9-8fe3-8760a1f414c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:59.180697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1269/2506] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:29:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:00.449418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:00.451292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:00.522446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7ef7-16ff-4305-9a03-aac00b27d6da service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:00.526191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:00.526886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:00.527244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:00.527589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:00.529661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:00.662370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:00.663808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:00.678173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1238/2507] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:02.691962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:02.692537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:02.693225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:02.714597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:02.715926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:02.781445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1270/2508] 10.222.0.88 () {58 vars in 967 bytes} [Mon Aug 29 23:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:02.793863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:02.813829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:02.867394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022a32-f8db-47bf-98d7-97c2f7597028 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:02.873818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:02.874478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:02.874763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:02.875039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:02.887512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:02.889324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:02.900758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1239/2509] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:30:04.801301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:04.802937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:04.826643 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce46d2-59e3-4dfa-8b59-c722374c4baa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:04.842896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:04.843568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:04.843851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:04.844119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] PATH_INFO: `/v3/users/55c184b749004ac298bb634bc948c537` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:04.845581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c184b749004ac298bb634bc948c537)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:04.847727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:04.921316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c184b749004ac298bb634bc948c537'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:04.922019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c184b749004ac298bb634bc948c537'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:04.929489 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c184b749004ac298bb634bc948c537'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:04.933246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:04.942576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c184b749004ac298bb634bc948c537'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:04.943232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-20c4fdd0-f1d9-4867-ba16-d574ac4d5890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c184b749004ac298bb634bc948c537'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:04.968272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1271/2510] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:04 2022] DELETE /identity/v3/users/55c184b749004ac298bb634bc948c537 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:05.182629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.195181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deff69-d1f5-4319-bd0c-874feb3ff2ea service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.262514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.263169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.263426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.263698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] PATH_INFO: `/v3/projects/396486227d8442bb93d95cce32aeee6d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.264802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=396486227d8442bb93d95cce32aeee6d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.266754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.314930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396486227d8442bb93d95cce32aeee6d', 'request_id': 'req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:05.322160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396486227d8442bb93d95cce32aeee6d', 'request_id': 'req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:05.328825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396486227d8442bb93d95cce32aeee6d', 'request_id': 'req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:05.339236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] The token cache is being invalidate because project 396486227d8442bb93d95cce32aeee6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:05.339631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:05.340274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfc519d1-26af-41a4-830f-7fd26bb9ea0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:05.342183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1240/2511] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:05 2022] DELETE /identity/v3/projects/396486227d8442bb93d95cce32aeee6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:05.347047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.347405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.347756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.367033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:05.368214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:05.425742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1272/2512] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:05.433696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.433984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.434265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.454751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:05.456097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:05.465722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1241/2513] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:05.471733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.483135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3b942-14d6-45a4-a77d-0f5b3ae4def4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.487758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.488364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.488645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.488921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.489638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:05.489944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.491540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.503615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1273/2514] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:05.508104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.518171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc001c1-b862-41cc-b261-edb51b99ed17 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.522776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.523403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.523679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.523949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.524582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.526514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.557472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1242/2515] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:05 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:05.558626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.569278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf44a-19b9-4b9b-a7b6-9d27122bd072 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.627032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.627650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.627955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.628227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.628856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.630804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.652231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1274/2516] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:05 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:05.657057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.667559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbea2fa-7340-410e-92dc-dd6680a96698 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.672226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.672842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.673156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.673433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.674073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.675659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.677746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:05.690307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1243/2517] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:05.697564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.711098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c155b-cecd-4d75-b5c5-88673262aea7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.715927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7b038-a3f2-4c8a-9642-1a91aab48999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.717404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b038-a3f2-4c8a-9642-1a91aab48999 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.717688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b038-a3f2-4c8a-9642-1a91aab48999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.717961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7b038-a3f2-4c8a-9642-1a91aab48999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.718606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b038-a3f2-4c8a-9642-1a91aab48999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.720205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7b038-a3f2-4c8a-9642-1a91aab48999 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.731540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1275/2518] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:05.736087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.746484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1d76d-ff61-41e3-a471-35469d13152e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.751467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.752173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.752458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.752759 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] PATH_INFO: `/v3/projects/bf7fe344221a4d4984eba516ed46f91a/users/ae2b2df3aaad4e14bd7dcc9ab54a0542/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.768443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7fe344221a4d4984eba516ed46f91a, user_id=ae2b2df3aaad4e14bd7dcc9ab54a0542, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:05.771153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:05.785436 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1244/2519] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:05 2022] PUT /identity/v3/projects/bf7fe344221a4d4984eba516ed46f91a/users/ae2b2df3aaad4e14bd7dcc9ab54a0542/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:05.797846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.798631 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.798988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:05.827665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] MFA Rules not processed for user `ae2b2df3aaad4e14bd7dcc9ab54a0542`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:05.828806 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:05.858495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:05.898163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1276/2520] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:05.910061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:05.911728 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:05.988092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ac8d-51e3-4572-9f36-877a2e01f311 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:05.993565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adecdd-2e2d-43ef-9f9b-73a20057c0be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:05.994169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adecdd-2e2d-43ef-9f9b-73a20057c0be service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:05.994446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adecdd-2e2d-43ef-9f9b-73a20057c0be service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:05.994719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adecdd-2e2d-43ef-9f9b-73a20057c0be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.002384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adecdd-2e2d-43ef-9f9b-73a20057c0be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:06.003960 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adecdd-2e2d-43ef-9f9b-73a20057c0be service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:06.012473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1245/2521] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:06.226551 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.293357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c74fe-1915-4e46-8520-f37476ffaff7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:06.298455 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:06.299091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.299372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.299733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] PATH_INFO: `/v3/users/ae2b2df3aaad4e14bd7dcc9ab54a0542` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.301072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2b2df3aaad4e14bd7dcc9ab54a0542)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:06.302760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:06.361245 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2b2df3aaad4e14bd7dcc9ab54a0542'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.361907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2b2df3aaad4e14bd7dcc9ab54a0542'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.369047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2b2df3aaad4e14bd7dcc9ab54a0542'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.376945 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2b2df3aaad4e14bd7dcc9ab54a0542'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.377570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2b2df3aaad4e14bd7dcc9ab54a0542'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.394352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1277/2522] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:06 2022] DELETE /identity/v3/users/ae2b2df3aaad4e14bd7dcc9ab54a0542 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:06.398762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.399246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.399349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.418476 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:06.420300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:06.477406 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1246/2523] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:06.488104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.489537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:06.549120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a0ef1-e59b-4d76-959e-3e3380910372 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:06.552763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f475cd1-e50a-4338-b381-89c43150140a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:06.553396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475cd1-e50a-4338-b381-89c43150140a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.553673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475cd1-e50a-4338-b381-89c43150140a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.553944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475cd1-e50a-4338-b381-89c43150140a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.559781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:06.564840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f475cd1-e50a-4338-b381-89c43150140a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:06.567266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f475cd1-e50a-4338-b381-89c43150140a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:06.577031 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1278/2524] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:06.852974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.854753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:06.867145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0464ead-630f-4881-9b4a-526db91c7a4f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:06.871796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:06.872440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.873274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.873550 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] PATH_INFO: `/v3/projects/bf7fe344221a4d4984eba516ed46f91a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.874704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7fe344221a4d4984eba516ed46f91a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:06.876620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:06.925723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7fe344221a4d4984eba516ed46f91a', 'request_id': 'req-c536789e-fded-439a-96e7-25c0ec8287c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.930102 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:06.934559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7fe344221a4d4984eba516ed46f91a', 'request_id': 'req-c536789e-fded-439a-96e7-25c0ec8287c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.944213 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7fe344221a4d4984eba516ed46f91a', 'request_id': 'req-c536789e-fded-439a-96e7-25c0ec8287c5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.954899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] The token cache is being invalidate because project bf7fe344221a4d4984eba516ed46f91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:06.955217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.955866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c536789e-fded-439a-96e7-25c0ec8287c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:06.957423 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1247/2525] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:06 2022] DELETE /identity/v3/projects/bf7fe344221a4d4984eba516ed46f91a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:06.962458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.962965 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.963078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.984810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:06.986022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:07.046021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1279/2526] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:07.054148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.054544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.054821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.075464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:07.077232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:07.084924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1248/2527] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:07.089231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.099340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b352ca7-4471-4119-95fc-d0b3ea88fd9b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.103803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.104400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.104681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.104971 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.105646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:07.105950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.107577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.119084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1280/2528] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:07.123943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.133265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69813687-dc4b-48b1-8930-b6cf9fdf90ec None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.137939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.139045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.139328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.139605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.140254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.142210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.182389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1249/2529] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:07 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:07.185743 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.196587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6140473-a053-493a-ab87-d7ad446f0221 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.255465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.256102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.256384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.256663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.257342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.259265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.281517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1281/2530] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:07 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:07.285888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.297216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4654b-8777-4f25-9e4f-62446c55377f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.301853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.302447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.302731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.303002 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.303635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.305260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.316262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1250/2531] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:07.320226 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.330044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486372c9-c653-430d-afa2-0757fb4974ea admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.334620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985097b-e307-4add-9b61-df5d27413d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.335215 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985097b-e307-4add-9b61-df5d27413d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.335496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985097b-e307-4add-9b61-df5d27413d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.335770 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985097b-e307-4add-9b61-df5d27413d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.336416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985097b-e307-4add-9b61-df5d27413d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.338039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985097b-e307-4add-9b61-df5d27413d3b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.348891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1282/2532] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:07.353262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.364380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142b0ef-56d2-47d6-8e01-54356339ba46 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.369057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.369751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.370031 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.370306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] PATH_INFO: `/v3/projects/3ff3fd7e85614d91858be01a1671a95e/users/51813a05cad741bfb968bbbe7e599d55/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.388036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff3fd7e85614d91858be01a1671a95e, user_id=51813a05cad741bfb968bbbe7e599d55, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.390795 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.414680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1251/2533] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:07 2022] PUT /identity/v3/projects/3ff3fd7e85614d91858be01a1671a95e/users/51813a05cad741bfb968bbbe7e599d55/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:07.427239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.427950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.428231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.461626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] MFA Rules not processed for user `51813a05cad741bfb968bbbe7e599d55`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:07.462896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:07.524421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:07.553935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1283/2534] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:07.558290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.632230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347e9d-453c-4529-ad50-484362f84128 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.637438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.638048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.638929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.639187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.639970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.641901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.670375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1252/2535] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:07 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:07.674397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.684827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376dea-bca1-4917-abfe-3ae2773c570b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.752949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.753596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.753877 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.754162 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.754794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.756781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.782067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1284/2536] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:07 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:07.783505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.794238 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964410a-f95f-4767-8aa4-9878120703d3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.800058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.800694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.800975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.801282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.801927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.803515 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.815128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1253/2537] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:07.819448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.829727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af4fab-c6cc-4060-8810-e0e7f819a732 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.834333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.834982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.835261 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.835529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] PATH_INFO: `/v3/projects/f0f09e06a16a47caa244bd5fe57d7ff9/users/49b14446f87a4fd9975c4fc8493a498b/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.850254 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f09e06a16a47caa244bd5fe57d7ff9, user_id=49b14446f87a4fd9975c4fc8493a498b, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.852884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.866497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1285/2538] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:07 2022] PUT /identity/v3/projects/f0f09e06a16a47caa244bd5fe57d7ff9/users/49b14446f87a4fd9975c4fc8493a498b/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:07.870708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.881327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ee6a-a7d6-457e-ad71-9e170c37c172 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.938488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:07.951580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e3c4f-39cf-4f0b-bb76-b274347362f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.952198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e3c4f-39cf-4f0b-bb76-b274347362f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.952480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e3c4f-39cf-4f0b-bb76-b274347362f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.952756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e3c4f-39cf-4f0b-bb76-b274347362f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.953557 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e3c4f-39cf-4f0b-bb76-b274347362f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.955163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e3c4f-39cf-4f0b-bb76-b274347362f3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.968328 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1254/2539] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:07.969876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.996834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae2085-68b4-4fb2-a443-eaf9c1f0c94b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:08.002573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:08.003237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:08.003515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:08.003781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] PATH_INFO: `/v3/projects/f0f09e06a16a47caa244bd5fe57d7ff9/users/49b14446f87a4fd9975c4fc8493a498b/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:08.005742 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f09e06a16a47caa244bd5fe57d7ff9, user_id=49b14446f87a4fd9975c4fc8493a498b, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:08.008349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:08.020167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1286/2540] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:07 2022] PUT /identity/v3/projects/f0f09e06a16a47caa244bd5fe57d7ff9/users/49b14446f87a4fd9975c4fc8493a498b/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:08.032072 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:08.032366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:08.032674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:08.061924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] MFA Rules not processed for user `49b14446f87a4fd9975c4fc8493a498b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:08.063200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:08.134484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1255/2541] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:08.155086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:08.157272 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:08.231701 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bf436-d433-46b5-9aa8-4cc8c2e84f48 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:08.236097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:08.236882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:08.239410 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:08.240329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:08.252831 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:08.254475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:08.284964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1287/2542] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:08.366651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:08.379202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb81ec-0afb-4de9-9dd0-bd52398ef63d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:08.383413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:08.387092 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:08.387431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:08.387734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:08.483338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:08.485248 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:08.496564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1256/2543] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:14.223576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:14.227052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:14.277992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:14.290466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ad70a-00d5-42e4-bb66-e85ff11164a6 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:14.295087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:14.295709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:14.295992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:14.296274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:14.298294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:14.362612 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:14.364059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bc5fb-8512-423d-92ca-46bea0a81f2b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:14.374437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1288/2544] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:15.585470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:15.599522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb1183-b02e-4966-b0b9-2055686de30d service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:15.608696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:15.609376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:15.609684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:15.609963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] PATH_INFO: `/v3/users/51813a05cad741bfb968bbbe7e599d55` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:15.611088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51813a05cad741bfb968bbbe7e599d55)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:15.613001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:15.674245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51813a05cad741bfb968bbbe7e599d55'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:15.675846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51813a05cad741bfb968bbbe7e599d55'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:15.689547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51813a05cad741bfb968bbbe7e599d55'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:15.712369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:15.714112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51813a05cad741bfb968bbbe7e599d55'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:15.715362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51813a05cad741bfb968bbbe7e599d55'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:15.739765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1257/2545] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:15 2022] DELETE /identity/v3/users/51813a05cad741bfb968bbbe7e599d55 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:15.744213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:15.745033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:15.745567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:15.769804 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:15.771264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:15.836210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1289/2546] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:15.852396 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:15.854006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:15.933841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481589a-bef1-45b3-8a2b-5e6b9564b50d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:15.945026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:15.945689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:15.946098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:15.946376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:15.960131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:15.961650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:15.972583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1258/2547] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:16.520491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:16.522894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:16.564350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73a3f-a0ff-4dc7-bf51-0675e8061b85 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:16.572639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:16.573320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:16.573603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:16.573876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] PATH_INFO: `/v3/projects/3ff3fd7e85614d91858be01a1671a95e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:16.575106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff3fd7e85614d91858be01a1671a95e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:16.579361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:16.643305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff3fd7e85614d91858be01a1671a95e', 'request_id': 'req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.649684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff3fd7e85614d91858be01a1671a95e', 'request_id': 'req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.658297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff3fd7e85614d91858be01a1671a95e', 'request_id': 'req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.670212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] The token cache is being invalidate because project 3ff3fd7e85614d91858be01a1671a95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:16.670516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.671151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.672939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1290/2548] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:16 2022] DELETE /identity/v3/projects/3ff3fd7e85614d91858be01a1671a95e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:16.677054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:16.688717 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427c760-2060-4c9a-8c9e-30cdbfdd3cda service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:16.807842 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:16.808698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:16.809101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:16.810204 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] PATH_INFO: `/v3/users/49b14446f87a4fd9975c4fc8493a498b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:16.811598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b14446f87a4fd9975c4fc8493a498b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:16.814105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:16.895553 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b14446f87a4fd9975c4fc8493a498b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.896421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b14446f87a4fd9975c4fc8493a498b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.912792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b14446f87a4fd9975c4fc8493a498b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.947109 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b14446f87a4fd9975c4fc8493a498b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.948324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-40273e6f-ac6a-43cc-95c9-7c13e6c9e896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b14446f87a4fd9975c4fc8493a498b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:16.964969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1259/2549] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:16 2022] DELETE /identity/v3/users/49b14446f87a4fd9975c4fc8493a498b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:17.300018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:17.301766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:17.318604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b9fc-d22e-4d32-bfa4-af6c413016a9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:17.340295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:17.433073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:17.433557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.434055 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.434352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] PATH_INFO: `/v3/projects/f0f09e06a16a47caa244bd5fe57d7ff9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.437531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f09e06a16a47caa244bd5fe57d7ff9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:17.440264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:17.501666 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f09e06a16a47caa244bd5fe57d7ff9', 'request_id': 'req-6108d943-6af0-4f15-ad86-707b61cfefe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:17.517644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f09e06a16a47caa244bd5fe57d7ff9', 'request_id': 'req-6108d943-6af0-4f15-ad86-707b61cfefe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:17.525669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f09e06a16a47caa244bd5fe57d7ff9', 'request_id': 'req-6108d943-6af0-4f15-ad86-707b61cfefe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:17.549160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] The token cache is being invalidate because project f0f09e06a16a47caa244bd5fe57d7ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:17.549390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:17.550121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6108d943-6af0-4f15-ad86-707b61cfefe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:17.552357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1291/2550] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:17 2022] DELETE /identity/v3/projects/f0f09e06a16a47caa244bd5fe57d7ff9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:17.558095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.558380 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.558663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.576958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:17.596364 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:17.597944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:17.686393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1260/2551] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:17.695128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.695128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.695465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.729981 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:17.738013 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:17.758374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1292/2552] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:17.763873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:17.776385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68de2ad-c75e-4a3b-9042-72263f7e0c76 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:17.795472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:17.796293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.796708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.797467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.798321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:17.798693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:17.800538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:17.836400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1261/2553] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:17.837823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:17.849025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fc6d6-ccf9-42a3-b554-1e72e8c7b111 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:17.868301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:17.868949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.869262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.869536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.870244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:17.872173 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:17.925157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1293/2554] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:17 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:17.927348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:17.939745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ad6d-f352-48ad-b14a-b6388eeba8d0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.035628 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.036581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.037296 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.037775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.038619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.042946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.046501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.048988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.070636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98d53b-9af0-4611-a6c9-3fdbf7c7b5f5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.072502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1262/2555] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:17 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:18.077086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.077582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.078235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.078712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.079210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] PATH_INFO: `/v3/users/4cc14630ede646698bb19f803e9952ad` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.080533 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc14630ede646698bb19f803e9952ad)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.082698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.090252 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895d3c-3d7b-4967-90dd-e3e5b88b36af admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.096407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.097022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.097341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.097619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.098272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.099880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.115090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1263/2556] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:18.116034 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.129048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82094cf-a2da-4432-afc0-d585de6160d6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.136361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.136986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.137303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.137571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.138919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.140663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.151408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1264/2557] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:18.155926 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.162209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc14630ede646698bb19f803e9952ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.162890 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc14630ede646698bb19f803e9952ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.167655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255a04-2c1c-4c44-b1d3-c6a2eb924e8e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.171260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc14630ede646698bb19f803e9952ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.179773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc14630ede646698bb19f803e9952ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.180871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-086e34bf-2c3b-461f-88f2-e57185ccac59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc14630ede646698bb19f803e9952ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.182053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.182740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.183022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.183299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] PATH_INFO: `/v3/projects/7f60b83213c14bbf8cd5542fa0cc3a5f/users/c943b7381e494a17a1f22cfccc321b45/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.196080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:18.207014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f60b83213c14bbf8cd5542fa0cc3a5f, user_id=c943b7381e494a17a1f22cfccc321b45, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.209861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.214217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1294/2558] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:18 2022] DELETE /identity/v3/users/4cc14630ede646698bb19f803e9952ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:18.236952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1265/2559] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:18 2022] PUT /identity/v3/projects/7f60b83213c14bbf8cd5542fa0cc3a5f/users/c943b7381e494a17a1f22cfccc321b45/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:18.251627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.251863 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.252157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.286012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] MFA Rules not processed for user `c943b7381e494a17a1f22cfccc321b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:18.287843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.366398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1295/2560] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:18.371174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.373434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.424473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:18.438147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.441051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.477421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e653b-8010-429d-a458-d04d37ea1ac9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.483187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.484010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.484363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.484704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.485458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.487895 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.522197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1266/2561] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:18.525813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1d5d6-3707-4a3f-ab39-1ee0cd26b1cd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.526214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.604327 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.604975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.605294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.605568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] PATH_INFO: `/v3/projects/0d5c124d1676439281367463aa3f2850` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.607491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5c124d1676439281367463aa3f2850)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.609878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.612258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ab31-7ec2-4287-a42b-83f42a25be57 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.617258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.617972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.618263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.618540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.619183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.621150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.647914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1267/2562] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:18.651459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.652650 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:18.662620 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d409-8d98-48fd-8ae8-2897dc199ae8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.670855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5c124d1676439281367463aa3f2850', 'request_id': 'req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.678276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5c124d1676439281367463aa3f2850', 'request_id': 'req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.687561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5c124d1676439281367463aa3f2850', 'request_id': 'req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.701550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] The token cache is being invalidate because project 0d5c124d1676439281367463aa3f2850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:18.701868 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.703147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dc2be1ea-b396-4af3-8a12-14ee5a8f17ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:18.705004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1296/2563] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:18 2022] DELETE /identity/v3/projects/0d5c124d1676439281367463aa3f2850 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:18.710577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86a6f-bbf4-46dc-9cd9-25ecd7904171 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.710947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86a6f-bbf4-46dc-9cd9-25ecd7904171 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.711295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86a6f-bbf4-46dc-9cd9-25ecd7904171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.727331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.728010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.728348 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.728548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.729524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.731183 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.734356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6bc86a6f-bbf4-46dc-9cd9-25ecd7904171 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:18.736601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6bc86a6f-bbf4-46dc-9cd9-25ecd7904171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.742883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1268/2564] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:18.752751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1297/2565] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:18.752919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.752919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.754418 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.754786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.755064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.765765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e051-8af6-4b9f-841f-4e0d183b5ad3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.772164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.772846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.773168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.773454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] PATH_INFO: `/v3/projects/d67492699b634cd2833183d302322eb1/users/7aa16fe661ce48bd8262f1baf7640c8f/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.777271 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:18.779066 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:18.789155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1298/2566] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:18.793228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.793585 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67492699b634cd2833183d302322eb1, user_id=7aa16fe661ce48bd8262f1baf7640c8f, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.796470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.804517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8ed3b-7ce8-40d9-b3dd-d77b28624a78 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.811992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.812611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.812941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.813320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.814328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:18.814669 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.816589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.818068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1269/2567] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:18 2022] PUT /identity/v3/projects/d67492699b634cd2833183d302322eb1/users/7aa16fe661ce48bd8262f1baf7640c8f/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:18.822073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.853168 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1299/2568] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:30:18.854070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.860011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:18.871887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8f49-44e8-45b7-b8cd-34b550946633 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.901434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de3e6-a978-45b7-bc66-ef5b39e2246d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.907541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.908162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.908572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.908857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.909735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.911352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.929374 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1270/2569] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:18.933801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.941270 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.942032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.942386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.942929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.943864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.945843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.946177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f2124-4fbb-47f4-818e-7e8d028e2e9e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.953547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d04020-2ca4-4cb9-8df9-a95b53a52733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.954480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04020-2ca4-4cb9-8df9-a95b53a52733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.954630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04020-2ca4-4cb9-8df9-a95b53a52733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.954834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d04020-2ca4-4cb9-8df9-a95b53a52733 admin admin] PATH_INFO: `/v3/projects/d67492699b634cd2833183d302322eb1/users/7aa16fe661ce48bd8262f1baf7640c8f/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.956863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d04020-2ca4-4cb9-8df9-a95b53a52733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67492699b634cd2833183d302322eb1, user_id=7aa16fe661ce48bd8262f1baf7640c8f, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.959825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d04020-2ca4-4cb9-8df9-a95b53a52733 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.972425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1271/2570] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:18 2022] PUT /identity/v3/projects/d67492699b634cd2833183d302322eb1/users/7aa16fe661ce48bd8262f1baf7640c8f/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:18.984220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.984881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.985433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.986446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1300/2571] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:18.990564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.019083 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] MFA Rules not processed for user `7aa16fe661ce48bd8262f1baf7640c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:19.020432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:19.065331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c773d2a-f34e-472d-ae31-e0e8e5c450dd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.070651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.071267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.071552 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.071826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.072461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.074795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.098690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1301/2572] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:19.102944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.107645 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1272/2573] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:19.117228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c15a6-4bb2-47b9-8b78-7e3e99edebfc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.119490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.120898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:19.123613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.124616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.124739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.124964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.125597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.127390 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.129646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:19.142873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1302/2574] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:19.146943 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.158941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a50b4b-650b-4287-b799-b9758f21cd98 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.166881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.167637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.168148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.168295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.169030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.171756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.185452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1303/2575] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:19.189578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.200280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad122-92d4-4031-a284-79a99f452609 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.205191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6209217-ce44-4ff6-ac4a-14349afede6c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.206008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.206907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.207199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.207494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] PATH_INFO: `/v3/projects/c9b4d0e6a18e479a9598851c6b8db988/users/83ecdd4eb70b4211906ee449d9452a97/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.209523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab8ae0-9e4f-4cc6-8dfa-7c588cc7e28e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.210335 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab8ae0-9e4f-4cc6-8dfa-7c588cc7e28e service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.210567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab8ae0-9e4f-4cc6-8dfa-7c588cc7e28e service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.211686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab8ae0-9e4f-4cc6-8dfa-7c588cc7e28e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.223894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab8ae0-9e4f-4cc6-8dfa-7c588cc7e28e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.224501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b4d0e6a18e479a9598851c6b8db988, user_id=83ecdd4eb70b4211906ee449d9452a97, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.225500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab8ae0-9e4f-4cc6-8dfa-7c588cc7e28e service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.227309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.237378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1273/2576] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:30:19.242937 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1304/2577] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:19 2022] PUT /identity/v3/projects/c9b4d0e6a18e479a9598851c6b8db988/users/83ecdd4eb70b4211906ee449d9452a97/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:19.254579 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.254906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.255157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.290950 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] MFA Rules not processed for user `83ecdd4eb70b4211906ee449d9452a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:19.292179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:19.320873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:19.374971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1274/2578] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:19.387109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.390011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:19.463214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c95d-dffe-4706-bf41-44ba994e32cf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.469361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7c1ec-e09f-4c27-affb-37e2eb7fd260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.470052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c1ec-e09f-4c27-affb-37e2eb7fd260 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.470330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c1ec-e09f-4c27-affb-37e2eb7fd260 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.470604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c1ec-e09f-4c27-affb-37e2eb7fd260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.479880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7c1ec-e09f-4c27-affb-37e2eb7fd260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.482543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7c1ec-e09f-4c27-affb-37e2eb7fd260 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.496105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1305/2579] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:19.736234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:19.817791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2bc5-c000-4c0f-b4af-39cdad0441f8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:19.828133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:19.828793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.829076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.829403 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] PATH_INFO: `/v3/users/c943b7381e494a17a1f22cfccc321b45` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.830564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c943b7381e494a17a1f22cfccc321b45)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:19.832818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:19.890966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c943b7381e494a17a1f22cfccc321b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:19.891657 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c943b7381e494a17a1f22cfccc321b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:19.900038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c943b7381e494a17a1f22cfccc321b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:19.912970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c943b7381e494a17a1f22cfccc321b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:19.913929 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c943b7381e494a17a1f22cfccc321b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:19.928310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1275/2580] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:19 2022] DELETE /identity/v3/users/c943b7381e494a17a1f22cfccc321b45 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:19.932967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:19.933297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:19.933578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:19.953401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:19.954626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:20.017358 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1306/2581] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:20.030475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:20.032195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:20.087498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:20.103514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bda5f-b9dc-4dea-8843-a43f2c6768f5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:20.110685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:20.111945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:20.111945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:20.112154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:20.126215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:20.128719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:20.142906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1276/2582] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:20.573383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:20.575033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:20.599092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfbd77-e10f-4854-8657-e1239ada2044 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:20.604126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:20.604708 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:20.605062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:20.605433 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] PATH_INFO: `/v3/projects/7f60b83213c14bbf8cd5542fa0cc3a5f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:20.606641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f60b83213c14bbf8cd5542fa0cc3a5f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:20.610558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:20.674227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f60b83213c14bbf8cd5542fa0cc3a5f', 'request_id': 'req-4fe97e63-9934-4f53-b309-e43059134500'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.681529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f60b83213c14bbf8cd5542fa0cc3a5f', 'request_id': 'req-4fe97e63-9934-4f53-b309-e43059134500'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.683231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:20.689956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f60b83213c14bbf8cd5542fa0cc3a5f', 'request_id': 'req-4fe97e63-9934-4f53-b309-e43059134500'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.707106 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] The token cache is being invalidate because project 7f60b83213c14bbf8cd5542fa0cc3a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:20.707487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.708209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.709800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1307/2583] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:20 2022] DELETE /identity/v3/projects/7f60b83213c14bbf8cd5542fa0cc3a5f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:20.713921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:20.724086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b69d17-952d-48f9-867e-cb2c4b9f9adb service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:20.784040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:20.784931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:20.785282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:20.785559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] PATH_INFO: `/v3/users/7aa16fe661ce48bd8262f1baf7640c8f` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:20.786725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa16fe661ce48bd8262f1baf7640c8f)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:20.788837 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:20.838773 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa16fe661ce48bd8262f1baf7640c8f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.839463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa16fe661ce48bd8262f1baf7640c8f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.850408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa16fe661ce48bd8262f1baf7640c8f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.864843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa16fe661ce48bd8262f1baf7640c8f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.865596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72c7b2ad-3c6a-494e-b699-734064adedd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa16fe661ce48bd8262f1baf7640c8f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:20.886595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1277/2584] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:20 2022] DELETE /identity/v3/users/7aa16fe661ce48bd8262f1baf7640c8f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:21.423626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:21.425494 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:21.446385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe97e63-9934-4f53-b309-e43059134500 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.515356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.516003 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.516278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.516547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] PATH_INFO: `/v3/projects/d67492699b634cd2833183d302322eb1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.517702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67492699b634cd2833183d302322eb1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.519871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.570815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67492699b634cd2833183d302322eb1', 'request_id': 'req-77994164-910e-4e77-8f52-3bf93cd02d1c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:21.577027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67492699b634cd2833183d302322eb1', 'request_id': 'req-77994164-910e-4e77-8f52-3bf93cd02d1c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:21.587288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67492699b634cd2833183d302322eb1', 'request_id': 'req-77994164-910e-4e77-8f52-3bf93cd02d1c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:21.600529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] The token cache is being invalidate because project d67492699b634cd2833183d302322eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:21.600932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:21.601722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77994164-910e-4e77-8f52-3bf93cd02d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:21.603812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1308/2585] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:21 2022] DELETE /identity/v3/projects/d67492699b634cd2833183d302322eb1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:21.611273 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc784a-3848-411d-887d-61535445447d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.611551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc784a-3848-411d-887d-61535445447d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.611919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc784a-3848-411d-887d-61535445447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.637317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-46bc784a-3848-411d-887d-61535445447d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:21.639288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-46bc784a-3848-411d-887d-61535445447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:21.717405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1278/2586] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:21.720640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.720927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.721263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.748539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:21.749706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:21.757871 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1309/2587] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:21.762237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc784a-3848-411d-887d-61535445447d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:21.772378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc784a-3848-411d-887d-61535445447d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.778908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.779577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.779857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.780126 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.780776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:21.781077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.782724 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.784484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:21.797904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1279/2588] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:21.801895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:21.811190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3e8c2-86b5-4be8-9630-26ab89a6b8bc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.816119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.816723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.817017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.817316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.817940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.819824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.854834 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1310/2589] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:21 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:21.855952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:21.866936 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60120b9-bf4d-4fb1-bc77-c71f20e8d4f0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.925985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.926603 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.926887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.927168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.927846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.929914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.952516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1280/2590] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:21 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:21.956680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:21.968765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd753d0-43e5-4d5d-9722-d58042a71c42 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.974336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.975022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.975332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.975609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.976258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.978052 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.989268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1311/2591] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:21.993676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.005163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958572-cc12-442a-9ca3-e69eabf736da admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.009959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633c7d2-80fc-45a6-af79-fb10c81d1efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.010600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633c7d2-80fc-45a6-af79-fb10c81d1efd admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.010861 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633c7d2-80fc-45a6-af79-fb10c81d1efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.011133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633c7d2-80fc-45a6-af79-fb10c81d1efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.011789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633c7d2-80fc-45a6-af79-fb10c81d1efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.014021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633c7d2-80fc-45a6-af79-fb10c81d1efd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.026765 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1281/2592] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:22.031278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.042153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445012-d91a-4cc8-994b-fc6b3bdb1772 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.047687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.048372 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.048653 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.048935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] PATH_INFO: `/v3/projects/cf2a818a41474aa38073ca166ab9683d/users/b23aff204abf4b2cba6657cf42abe1e3/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.066147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2a818a41474aa38073ca166ab9683d, user_id=b23aff204abf4b2cba6657cf42abe1e3, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.068826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.083765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1312/2593] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:22 2022] PUT /identity/v3/projects/cf2a818a41474aa38073ca166ab9683d/users/b23aff204abf4b2cba6657cf42abe1e3/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:22.095647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.096028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.096377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.129522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] MFA Rules not processed for user `b23aff204abf4b2cba6657cf42abe1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:22.130968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:22.202426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1282/2594] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:22.207195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.221378 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:22.277132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f984d-36c1-4957-bb53-377a10ae2b6f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.283258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.283874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.284159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.284437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.285081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.287040 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.316006 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1313/2595] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:22 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:22.320140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.331677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430434-efa9-4d3c-b187-ada119b5ac7c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.401077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.401778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.402079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.402382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.403023 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.405924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.417499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:22.453346 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1283/2596] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:22 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:22.454211 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.466451 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6706c7-966b-43a6-af4b-63617f3b31de admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.472043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.472721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.473067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.473503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.474435 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.476213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.492121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1314/2597] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:22.493982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.505596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bbf4f-9ce8-4d65-a167-0a68cfccf760 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.510989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.511866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.512397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.512568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] PATH_INFO: `/v3/projects/16d0072df27541cd96a4ffbf42673907/users/8b992bdcbb6b45c99f937681cde2a5a1/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.529305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d0072df27541cd96a4ffbf42673907, user_id=8b992bdcbb6b45c99f937681cde2a5a1, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.532168 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.549264 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1284/2598] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:22 2022] PUT /identity/v3/projects/16d0072df27541cd96a4ffbf42673907/users/8b992bdcbb6b45c99f937681cde2a5a1/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:22.553470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.566797 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61e9f-d8f9-48f5-b1f4-681b5856de30 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.653461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bcdea-aba6-41c1-b539-bfebc0cc29d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.654440 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bcdea-aba6-41c1-b539-bfebc0cc29d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.654726 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bcdea-aba6-41c1-b539-bfebc0cc29d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.655023 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bcdea-aba6-41c1-b539-bfebc0cc29d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.655689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bcdea-aba6-41c1-b539-bfebc0cc29d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.657507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bcdea-aba6-41c1-b539-bfebc0cc29d3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.668801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1315/2599] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:22.673663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.684455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427201c8-a475-42bf-b471-a5b7d1394374 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.690337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.691058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.691411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.691753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] PATH_INFO: `/v3/projects/16d0072df27541cd96a4ffbf42673907/users/8b992bdcbb6b45c99f937681cde2a5a1/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.693793 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d0072df27541cd96a4ffbf42673907, user_id=8b992bdcbb6b45c99f937681cde2a5a1, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.696526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.711176 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1285/2600] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:22 2022] PUT /identity/v3/projects/16d0072df27541cd96a4ffbf42673907/users/8b992bdcbb6b45c99f937681cde2a5a1/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:22.722508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.722744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.723024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.759330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] MFA Rules not processed for user `8b992bdcbb6b45c99f937681cde2a5a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:22.760671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:22.836244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1316/2601] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:22.848670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:22.850493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:22.909580 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2c407-b5f2-473d-b3df-4ac2e82eaaff admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:22.913261 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53753791-1121-4fcb-ad10-4397ab27e7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:22.913869 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53753791-1121-4fcb-ad10-4397ab27e7ab service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:22.914149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53753791-1121-4fcb-ad10-4397ab27e7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:22.914420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53753791-1121-4fcb-ad10-4397ab27e7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:22.924863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53753791-1121-4fcb-ad10-4397ab27e7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:22.926345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53753791-1121-4fcb-ad10-4397ab27e7ab service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:22.936827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1286/2602] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:24.393392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:24.411385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:24.517042 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7adf7-6f7b-4d54-9456-1d857d3c6d16 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:24.521759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:24.522403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:24.522685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:24.522994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] PATH_INFO: `/v3/users/b23aff204abf4b2cba6657cf42abe1e3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:24.524284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23aff204abf4b2cba6657cf42abe1e3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:24.526275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:24.587118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23aff204abf4b2cba6657cf42abe1e3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:24.588041 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23aff204abf4b2cba6657cf42abe1e3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:24.599678 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23aff204abf4b2cba6657cf42abe1e3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:24.610774 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23aff204abf4b2cba6657cf42abe1e3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:24.611837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23aff204abf4b2cba6657cf42abe1e3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:24.640772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1317/2603] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:24 2022] DELETE /identity/v3/users/b23aff204abf4b2cba6657cf42abe1e3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:24.645433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:24.646164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:24.646164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:24.703990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:24.705262 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:24.769318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1287/2604] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:24.780019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:24.781668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:24.842902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:24.870878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3e4c5-00fd-44e1-bd9f-98b4d4cc0f0d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:24.875997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:24.877020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:24.877246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:24.878164 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:24.891448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:24.893219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:24.913679 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1318/2605] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:30:25.244444 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:25.245921 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:25.260855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574919fa-34a2-4cef-99d8-40fab49511a8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:25.266942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:25.267606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:25.267890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:25.268157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] PATH_INFO: `/v3/projects/cf2a818a41474aa38073ca166ab9683d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:25.269325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2a818a41474aa38073ca166ab9683d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:25.271338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:25.304229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:25.322366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2a818a41474aa38073ca166ab9683d', 'request_id': 'req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.329624 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2a818a41474aa38073ca166ab9683d', 'request_id': 'req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.335883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2a818a41474aa38073ca166ab9683d', 'request_id': 'req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.347021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] The token cache is being invalidate because project cf2a818a41474aa38073ca166ab9683d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:25.347334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.347978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.349516 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1288/2606] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:25 2022] DELETE /identity/v3/projects/cf2a818a41474aa38073ca166ab9683d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:25.353744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:25.363640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b282ee5-08f0-4c15-9f7a-7db230e4aa3c service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:25.420938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:25.421620 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:25.421881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:25.422159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] PATH_INFO: `/v3/users/8b992bdcbb6b45c99f937681cde2a5a1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:25.423288 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b992bdcbb6b45c99f937681cde2a5a1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:25.425246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:25.477220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b992bdcbb6b45c99f937681cde2a5a1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.477885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b992bdcbb6b45c99f937681cde2a5a1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.485128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b992bdcbb6b45c99f937681cde2a5a1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.492443 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b992bdcbb6b45c99f937681cde2a5a1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.493129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0492b3cb-2141-47e0-9813-76314b8b4435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b992bdcbb6b45c99f937681cde2a5a1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.511508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1319/2607] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:25 2022] DELETE /identity/v3/users/8b992bdcbb6b45c99f937681cde2a5a1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:25.791118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:25.792691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:25.811578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a405-fe6b-4f4b-ba5b-73f47dc8011c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:25.869965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:25.870523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:25.870800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:25.871073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] PATH_INFO: `/v3/projects/16d0072df27541cd96a4ffbf42673907` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:25.872808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d0072df27541cd96a4ffbf42673907)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:25.875039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:25.922565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d0072df27541cd96a4ffbf42673907', 'request_id': 'req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.931734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d0072df27541cd96a4ffbf42673907', 'request_id': 'req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.939253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d0072df27541cd96a4ffbf42673907', 'request_id': 'req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.949675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] The token cache is being invalidate because project 16d0072df27541cd96a4ffbf42673907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:25.949966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.950734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-23dfe35a-e87e-44a0-97d3-63caddf5e6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:25.952298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1289/2608] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:25 2022] DELETE /identity/v3/projects/16d0072df27541cd96a4ffbf42673907 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:25.957143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:25.957436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:25.957714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.009049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:26.010306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:26.043767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:26.095549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1320/2609] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:26.104160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e1805-d499-4251-835e-5caad6321cad None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.104454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e1805-d499-4251-835e-5caad6321cad None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.104737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e1805-d499-4251-835e-5caad6321cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.130792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-400e1805-d499-4251-835e-5caad6321cad None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:26.132050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-400e1805-d499-4251-835e-5caad6321cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:26.143659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1290/2610] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:26.148119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.158782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969ba3-faad-4366-996d-e500eb130792 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.163603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.164207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.164736 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.165252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.165897 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:26.166196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.167795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.181300 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1321/2611] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:26.186206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e1805-d499-4251-835e-5caad6321cad None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.195920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e1805-d499-4251-835e-5caad6321cad None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.201918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.202786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.203095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.203708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.204075 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.206250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.235968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1291/2612] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:26.238889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.251730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec6a18-8085-492d-a0ec-7f3048f51b52 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.318130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.318788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.319071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.319343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.319976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.322015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.342847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1322/2613] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:26.346970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.358054 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0130f-6503-4c1e-bfed-6c15924502d0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.362702 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.363309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.363587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.363862 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.364506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.366258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.377435 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1292/2614] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:26.381428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.391731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9b5be-d415-4e40-b676-28b035a51260 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.396360 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f552b6-0800-4faa-b2f6-7ac470569950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.396964 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f552b6-0800-4faa-b2f6-7ac470569950 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.397278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f552b6-0800-4faa-b2f6-7ac470569950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.397556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f552b6-0800-4faa-b2f6-7ac470569950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.398207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f552b6-0800-4faa-b2f6-7ac470569950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.399801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f552b6-0800-4faa-b2f6-7ac470569950 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.411549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1323/2615] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:26.415992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.423395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:26.427767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa4a7-7892-42f5-a59b-d0c04ba398c6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.434157 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.435959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.435959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.436407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] PATH_INFO: `/v3/projects/c7e3ef8c63944e6bb0cd645fdc37527d/users/b60c8ac3965748d981eb6fdc0147c8b5/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.453823 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e3ef8c63944e6bb0cd645fdc37527d, user_id=b60c8ac3965748d981eb6fdc0147c8b5, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.458095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.473329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1293/2616] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:26 2022] PUT /identity/v3/projects/c7e3ef8c63944e6bb0cd645fdc37527d/users/b60c8ac3965748d981eb6fdc0147c8b5/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:26.485811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.486336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.486452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.517243 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] MFA Rules not processed for user `b60c8ac3965748d981eb6fdc0147c8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:26.518478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:26.597224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1324/2617] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:26.601631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.687234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb138-8e8d-451a-bbd9-d75250f799e9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.691975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.692584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.692863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.693161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.693922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.695971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.728495 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1294/2618] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:26.729681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.740546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff655e4-b1fc-41ed-b75d-923526018871 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.760888 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:26.802561 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.803202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.803479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.803765 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.804384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.806530 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.829521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1325/2619] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:26.834609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.846336 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a4c01-99cb-4f0b-91be-a372e1ce2d75 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.851454 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.852057 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.852337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.852608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.853282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.854870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.865601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1295/2620] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:26.869957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.880839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431842f0-71e4-428f-ba32-68ae53fa4f8a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.886130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.886814 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.887094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.887371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] PATH_INFO: `/v3/projects/636287c2b9e54e66ab935a340165f660/users/360dc4936af24c7982579f6dd8f7564f/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.903922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636287c2b9e54e66ab935a340165f660, user_id=360dc4936af24c7982579f6dd8f7564f, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.907322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:26.921912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1326/2621] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:26 2022] PUT /identity/v3/projects/636287c2b9e54e66ab935a340165f660/users/360dc4936af24c7982579f6dd8f7564f/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:26.926147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.936578 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19d654-18a6-452e-80fe-770c9f81cd5b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:26.993692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a474d83-ce91-48b4-9640-a0e7987fcf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:26.994426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474d83-ce91-48b4-9640-a0e7987fcf5f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.994708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474d83-ce91-48b4-9640-a0e7987fcf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.994984 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474d83-ce91-48b4-9640-a0e7987fcf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.995630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a474d83-ce91-48b4-9640-a0e7987fcf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:26.997317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a474d83-ce91-48b4-9640-a0e7987fcf5f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.007278 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1296/2622] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:27.011573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:27.022430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02bd96-c37c-445c-b58b-2f8fe8371361 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.027070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.027719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.027997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.028781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] PATH_INFO: `/v3/projects/636287c2b9e54e66ab935a340165f660/users/360dc4936af24c7982579f6dd8f7564f/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.030851 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636287c2b9e54e66ab935a340165f660, user_id=360dc4936af24c7982579f6dd8f7564f, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:27.033549 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.043922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1327/2623] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:27 2022] PUT /identity/v3/projects/636287c2b9e54e66ab935a340165f660/users/360dc4936af24c7982579f6dd8f7564f/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:27.054967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.055254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.055558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.082537 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] MFA Rules not processed for user `360dc4936af24c7982579f6dd8f7564f`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:27.083741 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:27.127941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:27.158284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1297/2624] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:27.170614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:27.172541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:27.244153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff73497-d17b-4723-8139-28ba5375b545 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.248257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e729d-dc7a-4a73-a454-a6712fe2de18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.248951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e729d-dc7a-4a73-a454-a6712fe2de18 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.249336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e729d-dc7a-4a73-a454-a6712fe2de18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.249621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e729d-dc7a-4a73-a454-a6712fe2de18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.311554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e729d-dc7a-4a73-a454-a6712fe2de18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:27.313072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e729d-dc7a-4a73-a454-a6712fe2de18 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.322660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1328/2625] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:28.273070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:28.274494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:28.349484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2e5a3-752e-4758-b962-8d46ea992e9c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:28.354260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:28.354884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:28.355160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:28.355431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] PATH_INFO: `/v3/users/83ecdd4eb70b4211906ee449d9452a97` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:28.357097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ecdd4eb70b4211906ee449d9452a97)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:28.359192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:28.410330 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ecdd4eb70b4211906ee449d9452a97'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:28.411008 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ecdd4eb70b4211906ee449d9452a97'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:28.420385 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ecdd4eb70b4211906ee449d9452a97'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:28.435154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ecdd4eb70b4211906ee449d9452a97'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:28.435956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ecdd4eb70b4211906ee449d9452a97'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:28.449522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1298/2626] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:28 2022] DELETE /identity/v3/users/83ecdd4eb70b4211906ee449d9452a97 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:28.454159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:28.454717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:28.454813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:28.474618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:28.475843 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:28.506274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:28.547604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1329/2627] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:28.558142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:28.559635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:28.641437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c28a-0bb4-4ae2-9b33-afe9f7bc6fb3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:28.645190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1eb00-3231-471e-8e68-8c815d32a0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:28.645809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1eb00-3231-471e-8e68-8c815d32a0bc service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:28.646086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1eb00-3231-471e-8e68-8c815d32a0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:28.646353 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1eb00-3231-471e-8e68-8c815d32a0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:28.656889 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1eb00-3231-471e-8e68-8c815d32a0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:28.659409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1eb00-3231-471e-8e68-8c815d32a0bc service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:28.663613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:28.676991 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1299/2628] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:29.018938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.020926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.034636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee818720-a254-48ff-81f0-8e7fcb9d14e4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.039997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.040662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.040995 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.041349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] PATH_INFO: `/v3/projects/c9b4d0e6a18e479a9598851c6b8db988` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.042584 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b4d0e6a18e479a9598851c6b8db988)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.045450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.094112 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b4d0e6a18e479a9598851c6b8db988', 'request_id': 'req-691f2097-0011-45f1-a211-dece40c9df9b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:29.100714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b4d0e6a18e479a9598851c6b8db988', 'request_id': 'req-691f2097-0011-45f1-a211-dece40c9df9b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:29.109646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b4d0e6a18e479a9598851c6b8db988', 'request_id': 'req-691f2097-0011-45f1-a211-dece40c9df9b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:29.123475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] The token cache is being invalidate because project c9b4d0e6a18e479a9598851c6b8db988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:29.123475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:29.124336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-691f2097-0011-45f1-a211-dece40c9df9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:29.126515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1330/2629] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:29 2022] DELETE /identity/v3/projects/c9b4d0e6a18e479a9598851c6b8db988 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:29.131764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.132053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.132334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.156133 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:29.157378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.222118 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1300/2630] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:29.232476 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.232768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.233044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.255660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:29.257094 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.267857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1331/2631] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:29.272360 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.283631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284bdd2-e47a-45b8-b5e1-2ccb220d3890 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.288280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.288886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.289387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.289920 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.290568 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:29.290871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.292453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.305969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1301/2632] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:29.310285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.319698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bd857-b5a9-4dc5-a23a-dbdb4ab8a29c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.326916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.328091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.328578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.328903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.329712 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.332177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.365139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1332/2633] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:29 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:29.369913 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.381216 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ac5da-4cd0-4036-80a2-462bf413f479 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.445490 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.446139 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.446426 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.446774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.449268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.449424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.475888 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1302/2634] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:29 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:29.477127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.487872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651bbf61-a6ad-4943-84e4-88748d5b2d33 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.492507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.493150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.493432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.493727 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.494347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.495966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.507205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1333/2635] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:29.512132 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.523866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f390b-5e46-4aed-a033-61827a56d416 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.528812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0024bc-e11a-40db-a486-8029ab810117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.529461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0024bc-e11a-40db-a486-8029ab810117 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.529751 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0024bc-e11a-40db-a486-8029ab810117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.530665 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0024bc-e11a-40db-a486-8029ab810117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.531371 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0024bc-e11a-40db-a486-8029ab810117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.533097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0024bc-e11a-40db-a486-8029ab810117 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.545600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1303/2636] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:29.549904 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.562776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81191c7-a3a0-4563-8f88-c1b87ecd561a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.567685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.568377 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.568658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.568934 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] PATH_INFO: `/v3/projects/b2ad94380e0447d8b0d46e042ebe89b7/users/ccd8d7dc70f643cd826cc20202e1be50/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.585402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ad94380e0447d8b0d46e042ebe89b7, user_id=ccd8d7dc70f643cd826cc20202e1be50, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.588124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.602882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1334/2637] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:29 2022] PUT /identity/v3/projects/b2ad94380e0447d8b0d46e042ebe89b7/users/ccd8d7dc70f643cd826cc20202e1be50/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:29.608257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.608563 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.608839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.663323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:29.663323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.735457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1304/2638] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:29.745652 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.747395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.822080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940035e-6ace-4704-9786-d458d737b771 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:29.827935 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:29.828715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.829234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.829841 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.841495 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:29.841999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:29.844234 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:29.856331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1335/2639] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:29.955208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.957088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.964079 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:30.027120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026826b4-0328-43ea-b9f6-3cb5601121cc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.035063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.036056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.036394 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.036730 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.038859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:30.076262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:30.077817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:30.094341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c49a26-13fa-4bed-a98d-98f4a06c5bb8 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.098896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.099872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.100310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.100796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.102977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:30.117482 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.118942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e4906-4f9c-4a95-8630-fd495506f30e service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.134140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1305/2640] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:30.187432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.188990 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.209336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1336/2641] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:30:30.884228 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.884835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.884835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.915473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] MFA Rules not processed for user `ccd8d7dc70f643cd826cc20202e1be50`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:30.916698 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:30.998990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1306/2642] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:31.003719 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:31.015409 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b57a9-18b0-4d1d-af22-ab64c575ae56 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:31.020267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:31.020900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:31.021212 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:31.021487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:31.022148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:31.024033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:31.063972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1337/2643] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:31 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:31.065190 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:31.077716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169b916-6d14-4269-9dae-9c93a56fa89c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:31.123187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:31.145860 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:31.146410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:31.146692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:31.146968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:31.147625 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:31.149858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:31.176086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1307/2644] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:31 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:31.180114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:31.203573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0033e-c11c-4a19-b866-c78b611d0001 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:31.212340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:31.213286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:31.213865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:31.214285 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:31.214952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:31.217630 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:31.229660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1338/2645] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:31.233918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:31.245743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c37fa-a8bd-4e5b-b9f9-460bd72db02d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:31.253705 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:31.256695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:31.257043 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:31.257363 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] PATH_INFO: `/v3/projects/926985d74ae74192a95ff9a7701c1b89/users/79f2bc77a77346108f6d551dc085f175/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:31.275764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926985d74ae74192a95ff9a7701c1b89, user_id=79f2bc77a77346108f6d551dc085f175, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:31.281372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:31.300302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1308/2646] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:31 2022] PUT /identity/v3/projects/926985d74ae74192a95ff9a7701c1b89/users/79f2bc77a77346108f6d551dc085f175/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:31.305278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:31.320384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a191e5c-fd7e-4bbd-bb49-8ad6d019e079 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:31.389813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25a4fc-e857-4195-8fc6-45a24ddb0ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:31.390592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25a4fc-e857-4195-8fc6-45a24ddb0ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:31.390920 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25a4fc-e857-4195-8fc6-45a24ddb0ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:31.391205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25a4fc-e857-4195-8fc6-45a24ddb0ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:31.392086 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25a4fc-e857-4195-8fc6-45a24ddb0ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:31.394665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25a4fc-e857-4195-8fc6-45a24ddb0ba1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:31.409707 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1339/2647] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:31.411281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:31.424971 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d549211-7e1c-45af-9310-3d55d8032e25 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:31.431290 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:31.431974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:31.432254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:31.432527 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] PATH_INFO: `/v3/projects/926985d74ae74192a95ff9a7701c1b89/users/79f2bc77a77346108f6d551dc085f175/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:31.435311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] RBAC: Authorizing `identity:create_grant(project_id=926985d74ae74192a95ff9a7701c1b89, user_id=79f2bc77a77346108f6d551dc085f175, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:31.438311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:31.450919 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1309/2648] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:31 2022] PUT /identity/v3/projects/926985d74ae74192a95ff9a7701c1b89/users/79f2bc77a77346108f6d551dc085f175/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:32.277947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:32.279249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:32.279249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:32.335496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] MFA Rules not processed for user `79f2bc77a77346108f6d551dc085f175`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:32.337417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:32.405356 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:32.455516 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1340/2649] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:33.187958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:33.190651 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:33.354604 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bba12a-6437-401b-b52f-0148aadd259f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:33.362284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:33.362910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:33.363188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:33.363460 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:33.365473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:33.380622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:33.382331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:33.405691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1310/2650] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:34.194235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:34.287233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ad89a-6892-462e-b941-af2c44dd2295 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:34.292933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:34.293670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:34.294645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:34.294966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] PATH_INFO: `/v3/users/ccd8d7dc70f643cd826cc20202e1be50` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:34.297078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd8d7dc70f643cd826cc20202e1be50)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:34.299056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:34.361199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd8d7dc70f643cd826cc20202e1be50'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.361947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd8d7dc70f643cd826cc20202e1be50'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.369380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd8d7dc70f643cd826cc20202e1be50'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.378673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd8d7dc70f643cd826cc20202e1be50'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.379432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd8d7dc70f643cd826cc20202e1be50'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.398923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1341/2651] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:34 2022] DELETE /identity/v3/users/ccd8d7dc70f643cd826cc20202e1be50 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:34.585458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:34.600247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd3f5b-1598-498d-9450-fdfb5d599d57 service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:34.669674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:34.670308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:34.670581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:34.671000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] PATH_INFO: `/v3/projects/b2ad94380e0447d8b0d46e042ebe89b7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:34.672135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ad94380e0447d8b0d46e042ebe89b7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:34.674177 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:34.682843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:34.728038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ad94380e0447d8b0d46e042ebe89b7', 'request_id': 'req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.735393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ad94380e0447d8b0d46e042ebe89b7', 'request_id': 'req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.742689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ad94380e0447d8b0d46e042ebe89b7', 'request_id': 'req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.754292 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] The token cache is being invalidate because project b2ad94380e0447d8b0d46e042ebe89b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:34.754583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.755247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.759798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1311/2652] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:34 2022] DELETE /identity/v3/projects/b2ad94380e0447d8b0d46e042ebe89b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:34.760939 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:34.763092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:34.776604 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818bb4e-2113-4111-858e-95e579f4d064 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:34.833569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:34.842262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:34.842997 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:34.843704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:34.844177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] PATH_INFO: `/v3/users/79f2bc77a77346108f6d551dc085f175` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:34.845544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f2bc77a77346108f6d551dc085f175)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:34.847477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:34.899608 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f2bc77a77346108f6d551dc085f175'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.900381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f2bc77a77346108f6d551dc085f175'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.907985 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f2bc77a77346108f6d551dc085f175'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.915422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f2bc77a77346108f6d551dc085f175'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.916108 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7f5cc5ff-4c22-4707-9622-ead8e9d0da4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f2bc77a77346108f6d551dc085f175'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:34.935198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1342/2653] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:34 2022] DELETE /identity/v3/users/79f2bc77a77346108f6d551dc085f175 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:35.126429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.130846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:35.158310 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4e5ec-b12c-4637-ab33-bd5b36b2f779 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.231506 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.232158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.232434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.232710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] PATH_INFO: `/v3/projects/926985d74ae74192a95ff9a7701c1b89` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.233881 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] RBAC: Authorizing `identity:delete_project(project_id=926985d74ae74192a95ff9a7701c1b89)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.235787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.291163 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926985d74ae74192a95ff9a7701c1b89', 'request_id': 'req-0636ffdb-42da-4b2d-8f04-6765b0ad159f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:35.299487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926985d74ae74192a95ff9a7701c1b89', 'request_id': 'req-0636ffdb-42da-4b2d-8f04-6765b0ad159f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:35.306595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926985d74ae74192a95ff9a7701c1b89', 'request_id': 'req-0636ffdb-42da-4b2d-8f04-6765b0ad159f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:35.318171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] The token cache is being invalidate because project 926985d74ae74192a95ff9a7701c1b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:35.318459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:35.319107 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0636ffdb-42da-4b2d-8f04-6765b0ad159f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:35.320986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1312/2654] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:35 2022] DELETE /identity/v3/projects/926985d74ae74192a95ff9a7701c1b89 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:35.326600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.327080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.327181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.354090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:35.354786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:35.441222 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1343/2655] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:35.445156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.445493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.449022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.480871 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:35.483357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:35.494909 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1313/2656] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:35.498880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.509614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47904ab8-8392-4379-8261-cfc516035f90 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.515128 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.515900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.516149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.516429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.517085 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:35.517420 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.519092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.533931 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1344/2657] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:35.538059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.554231 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb874e-d958-4311-be5c-d7a5f68bb6fb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.561774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.562438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.562769 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.563302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.564103 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.566351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.592923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:35.605878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1314/2658] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:35 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:35.606958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.624577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f5315-f6dc-4144-b47c-385c9f860d12 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.784104 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.784734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.785017 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.785363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.786000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.788132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.798697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:35.817467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1345/2659] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:35 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:35.820590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.832207 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287a1f6-e3fa-4bb0-aac6-57a232f98e7b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.836975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.837630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.837908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.838192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.838833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.840425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.851735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1315/2660] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:35.855764 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.867459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785afb43-cefd-4db6-b3bd-2863582c530b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.873129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c9bd8-1c05-4cd8-a924-c35da1314a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.873899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9bd8-1c05-4cd8-a924-c35da1314a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.874246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9bd8-1c05-4cd8-a924-c35da1314a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.874607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c9bd8-1c05-4cd8-a924-c35da1314a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.875171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9bd8-1c05-4cd8-a924-c35da1314a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.876840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c9bd8-1c05-4cd8-a924-c35da1314a3f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.894295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1346/2661] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:35.895437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:35.908158 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6fdb-95ae-4977-8dc3-6a0d62a82f62 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:35.913347 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:35.914112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.914390 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.914924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] PATH_INFO: `/v3/projects/a533610e5d0c45bea07cfe3992a09f7e/users/1c3e5ae3aff14dbc94a980926bb74449/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.930790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a533610e5d0c45bea07cfe3992a09f7e, user_id=1c3e5ae3aff14dbc94a980926bb74449, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:35.933512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:35.953370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1316/2662] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:35 2022] PUT /identity/v3/projects/a533610e5d0c45bea07cfe3992a09f7e/users/1c3e5ae3aff14dbc94a980926bb74449/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:35.964119 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:35.964503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:35.964777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:35.996948 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] MFA Rules not processed for user `1c3e5ae3aff14dbc94a980926bb74449`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:35.998404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:36.067486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1347/2663] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:36.072172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.143976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29d253-385e-4140-8d63-cdce6d7ea2a9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.148780 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.149369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.149681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.149954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.150599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.152616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.180483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1317/2664] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:36 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:36.185319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.196885 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f093740-dcd0-4521-90cb-2c6872515b13 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.257059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.257735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.258010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.258281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.258909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.260819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.286902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1348/2665] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:36 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:36.291153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.302904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472897a-a86f-416e-86f7-a303e2b57c20 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.308126 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.309081 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.309726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.310010 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.310668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.312276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.324064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1318/2666] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:36.328919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.339922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c92428-4bf8-4756-9f7c-b65f53ce130a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.345337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.346015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.346293 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.346571 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] PATH_INFO: `/v3/projects/cd9e3e2726964463a5673fc90c47e362/users/445b6050cbf445009dde44f458c83e1b/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.362993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9e3e2726964463a5673fc90c47e362, user_id=445b6050cbf445009dde44f458c83e1b, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.365740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.382753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1349/2667] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:36 2022] PUT /identity/v3/projects/cd9e3e2726964463a5673fc90c47e362/users/445b6050cbf445009dde44f458c83e1b/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:36.386791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.398146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd752-7a30-4f70-b5a0-dd9874e4d0fc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.460020 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff9694-39e0-41f0-9f8b-b2766e0c5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.460472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff9694-39e0-41f0-9f8b-b2766e0c5cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.460885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff9694-39e0-41f0-9f8b-b2766e0c5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.461242 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff9694-39e0-41f0-9f8b-b2766e0c5cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.461883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff9694-39e0-41f0-9f8b-b2766e0c5cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.463545 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff9694-39e0-41f0-9f8b-b2766e0c5cd5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.477744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1319/2668] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:36.479004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.491116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51839b-b9cb-44de-9f25-bbaf8dbf62dd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.495966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.496734 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.497782 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.498359 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] PATH_INFO: `/v3/projects/cd9e3e2726964463a5673fc90c47e362/users/445b6050cbf445009dde44f458c83e1b/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.500424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9e3e2726964463a5673fc90c47e362, user_id=445b6050cbf445009dde44f458c83e1b, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.503343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.515239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1350/2669] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:36 2022] PUT /identity/v3/projects/cd9e3e2726964463a5673fc90c47e362/users/445b6050cbf445009dde44f458c83e1b/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:36.527229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.527513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.527789 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.558715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] MFA Rules not processed for user `445b6050cbf445009dde44f458c83e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:36.560047 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:36.582367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:36.639790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1320/2670] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:36.651148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.652923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:36.681685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:36.719737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167073b-dfd7-4bc3-9fac-af53b73316a0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.724676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.725400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.725748 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.726024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.736573 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.738075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.747597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1351/2671] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:36.802616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:36.817048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69417f68-d447-4dc1-8158-fbf855a6f8f2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:36.821487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4949926-ecc0-4af1-a1b1-73809d47a726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:36.822212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4949926-ecc0-4af1-a1b1-73809d47a726 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:36.822714 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4949926-ecc0-4af1-a1b1-73809d47a726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:36.822958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4949926-ecc0-4af1-a1b1-73809d47a726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:36.899664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4949926-ecc0-4af1-a1b1-73809d47a726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:36.901378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4949926-ecc0-4af1-a1b1-73809d47a726 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:36.913161 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1321/2672] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:40.406951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:40.471172 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a10e77-badd-4731-8224-bcf5abe543ce service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:40.475670 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:40.476331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:40.476616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:40.476919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] PATH_INFO: `/v3/users/1c3e5ae3aff14dbc94a980926bb74449` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:40.478072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3e5ae3aff14dbc94a980926bb74449)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:40.479989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:40.531921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3e5ae3aff14dbc94a980926bb74449'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:40.532788 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3e5ae3aff14dbc94a980926bb74449'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:40.540380 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3e5ae3aff14dbc94a980926bb74449'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:40.547946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3e5ae3aff14dbc94a980926bb74449'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:40.548595 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3e5ae3aff14dbc94a980926bb74449'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:40.566697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1352/2673] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:40 2022] DELETE /identity/v3/users/1c3e5ae3aff14dbc94a980926bb74449 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:40.571306 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:40.571824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:40.572106 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:40.600142 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:40.602150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:40.670636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1322/2674] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:40.680139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:40.681576 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:40.733362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:40.745800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8426a7-5e4b-4ca8-89a1-830a3eddfa43 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:40.752230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:40.752840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:40.753131 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:40.753416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:40.763781 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:40.764963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:40.774824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1353/2675] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:41.058415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:41.059965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:41.073063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b9f0-aed1-4657-a984-ae1667235af6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:41.078744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:41.079405 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.079660 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.079943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] PATH_INFO: `/v3/projects/a533610e5d0c45bea07cfe3992a09f7e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.081080 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a533610e5d0c45bea07cfe3992a09f7e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:41.083040 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:41.136664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a533610e5d0c45bea07cfe3992a09f7e', 'request_id': 'req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.140438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:41.146068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a533610e5d0c45bea07cfe3992a09f7e', 'request_id': 'req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.153514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a533610e5d0c45bea07cfe3992a09f7e', 'request_id': 'req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.164520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] The token cache is being invalidate because project a533610e5d0c45bea07cfe3992a09f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:41.165022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.165715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.167223 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1323/2676] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:41 2022] DELETE /identity/v3/projects/a533610e5d0c45bea07cfe3992a09f7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:41.171557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:41.181334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d34e52-9ad3-4c89-9193-4ec4e09ec59f service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:41.241616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:41.242240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.242515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.242783 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] PATH_INFO: `/v3/users/445b6050cbf445009dde44f458c83e1b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.243880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=445b6050cbf445009dde44f458c83e1b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:41.245815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:41.291505 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445b6050cbf445009dde44f458c83e1b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.292163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445b6050cbf445009dde44f458c83e1b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.298993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445b6050cbf445009dde44f458c83e1b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.306401 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445b6050cbf445009dde44f458c83e1b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.307027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7470f1ad-2143-426f-82cb-a7e7fb2d7fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445b6050cbf445009dde44f458c83e1b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.324570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1354/2677] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:41 2022] DELETE /identity/v3/users/445b6050cbf445009dde44f458c83e1b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:41.614104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:41.616904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:41.632851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30419a93-b7e1-4b96-a5f9-2f2b0891ef2e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:41.698650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:41.699206 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.699509 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.699918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] PATH_INFO: `/v3/projects/cd9e3e2726964463a5673fc90c47e362` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.701338 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9e3e2726964463a5673fc90c47e362)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:41.703241 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:41.753927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9e3e2726964463a5673fc90c47e362', 'request_id': 'req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.761226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9e3e2726964463a5673fc90c47e362', 'request_id': 'req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.768373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9e3e2726964463a5673fc90c47e362', 'request_id': 'req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.779061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] The token cache is being invalidate because project cd9e3e2726964463a5673fc90c47e362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:41.779343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.779988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6f46d67a-5845-4b7e-8ecb-1f72bc023a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:41.781538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1324/2678] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:41 2022] DELETE /identity/v3/projects/cd9e3e2726964463a5673fc90c47e362 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:41.786458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.786949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.787050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.807592 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:41.808802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:41.867105 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1355/2679] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:41.875597 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.875882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.876155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.896015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:41.897253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:41.905738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1325/2680] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:41.910009 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:41.920457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c173b36-2c4b-4509-937b-c732dbb59cbd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:41.925067 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:41.925682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.925959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.926228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.926864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:41.927161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:41.929184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:41.930984 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:41.944001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1356/2681] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:41.948508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:41.957877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49210ebc-4399-4341-812f-50d8d8cbe3df None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:41.962408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:41.962993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:41.963267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:41.963535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:41.964166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:41.966722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:41.992844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1326/2682] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:41 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:41.997463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.007601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70283cfa-b6cc-43af-851d-3b98be652176 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.069824 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.070471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.070751 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.071020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.071667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.074076 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.105078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1357/2683] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:41 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:42.106493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.118334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d61b-eae7-469f-8f77-b22b649e1697 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.123340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.123835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.124192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.124493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.125442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.127153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.141199 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1327/2684] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:42.143953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.154735 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a84ade-9041-44a9-a354-4bec27a200d3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.159246 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493da96-ec2a-4898-9c8b-fb3fe5d48819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.159836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493da96-ec2a-4898-9c8b-fb3fe5d48819 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.160113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493da96-ec2a-4898-9c8b-fb3fe5d48819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.160384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493da96-ec2a-4898-9c8b-fb3fe5d48819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.161054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493da96-ec2a-4898-9c8b-fb3fe5d48819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.162675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493da96-ec2a-4898-9c8b-fb3fe5d48819 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.174290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1358/2685] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:42.178505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.189441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff7ec4-cd51-479b-89d5-db2d720b9779 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.194221 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.194896 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.195145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.195427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] PATH_INFO: `/v3/projects/85430f6b99a949d0a49acab18b44017e/users/20e3a30a7ede45faae4115c8448a2168/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.210798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85430f6b99a949d0a49acab18b44017e, user_id=20e3a30a7ede45faae4115c8448a2168, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.213725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.228513 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1328/2686] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:42 2022] PUT /identity/v3/projects/85430f6b99a949d0a49acab18b44017e/users/20e3a30a7ede45faae4115c8448a2168/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:42.239597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.239886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.240166 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.272082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] MFA Rules not processed for user `20e3a30a7ede45faae4115c8448a2168`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:42.273462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:42.342145 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1359/2687] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:42.346746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.355560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:42.413203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae4b74-fb22-47fa-9bc1-788e45edcf2b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.421351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.422378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.422875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.423373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.424519 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.428244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.456650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1329/2688] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:42 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:42.460787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.472274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102ca2e-cfca-47d6-aa06-35fb68cb49b0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.528826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.529554 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.529835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.530111 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.530830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.532760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.542039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:42.554862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1360/2689] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:42 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:42.558747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.568867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f8c3-e20f-4483-9541-16b106c769c1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.573508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.574110 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.574393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.574670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.575854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.577531 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.591187 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1330/2690] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:42.595423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.606029 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3890a-47c1-4c9e-b715-74f8285e6870 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.610917 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.611599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.611910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.612217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] PATH_INFO: `/v3/projects/769873e61ae94e80a10c1ab99f70c53c/users/4591062886a14955a4144f4106105db2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.627091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769873e61ae94e80a10c1ab99f70c53c, user_id=4591062886a14955a4144f4106105db2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.629777 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.643205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1361/2691] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:42 2022] PUT /identity/v3/projects/769873e61ae94e80a10c1ab99f70c53c/users/4591062886a14955a4144f4106105db2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:42.647270 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.657652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f28e3-ab04-4836-87ac-49297bd18530 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.715583 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cca9c-c3db-43b3-8c84-3ea7e82a3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.716214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cca9c-c3db-43b3-8c84-3ea7e82a3af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.716494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cca9c-c3db-43b3-8c84-3ea7e82a3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.716768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cca9c-c3db-43b3-8c84-3ea7e82a3af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.717463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cca9c-c3db-43b3-8c84-3ea7e82a3af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.719042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cca9c-c3db-43b3-8c84-3ea7e82a3af1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.728901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1331/2692] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:42.733170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.743333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2900769-98dc-4cc9-bf5f-ec86aafad2f6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.748602 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.749296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.749578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.749882 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] PATH_INFO: `/v3/projects/769873e61ae94e80a10c1ab99f70c53c/users/4591062886a14955a4144f4106105db2/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.751808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769873e61ae94e80a10c1ab99f70c53c, user_id=4591062886a14955a4144f4106105db2, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.754525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.765230 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1362/2693] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:42 2022] PUT /identity/v3/projects/769873e61ae94e80a10c1ab99f70c53c/users/4591062886a14955a4144f4106105db2/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:42.777409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.777694 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.778014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.807149 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] MFA Rules not processed for user `4591062886a14955a4144f4106105db2`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:42.808361 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:42.877738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1332/2694] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:42.889832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:42.891560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:42.947835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec198a32-f393-430f-a77e-40e3ccd85339 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:42.952169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:42.952766 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:42.953049 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:42.953353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:42.962504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:42.963946 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:42.973900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1363/2695] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:43.055768 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:43.060539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:43.066917 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2de0a-20b0-4a64-b7d0-0598749aa494 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:43.070598 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7aa1d-2438-49f5-ad17-da0cc060ec87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:43.071191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7aa1d-2438-49f5-ad17-da0cc060ec87 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:43.071464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7aa1d-2438-49f5-ad17-da0cc060ec87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:43.071736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7aa1d-2438-49f5-ad17-da0cc060ec87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:43.131601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7aa1d-2438-49f5-ad17-da0cc060ec87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:43.133044 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7aa1d-2438-49f5-ad17-da0cc060ec87 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:43.142729 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1333/2696] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:43.162021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:43.164046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:43.230542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d655b9-ad5f-4bdc-aa6e-3952614b330a service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:43.236135 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:43.236763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:43.237036 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:43.237340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] PATH_INFO: `/v3/users/b60c8ac3965748d981eb6fdc0147c8b5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:43.238446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60c8ac3965748d981eb6fdc0147c8b5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:43.240357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:43.296186 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60c8ac3965748d981eb6fdc0147c8b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.296849 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60c8ac3965748d981eb6fdc0147c8b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.304197 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60c8ac3965748d981eb6fdc0147c8b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.306763 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:43.311992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60c8ac3965748d981eb6fdc0147c8b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.312615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60c8ac3965748d981eb6fdc0147c8b5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.336623 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:43.336906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:43.337200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1364/2697] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:43 2022] DELETE /identity/v3/users/b60c8ac3965748d981eb6fdc0147c8b5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:43.337359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:43.357589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:43.359237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:43.424074 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1334/2698] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:43.435187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:43.436772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:43.535005 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60367ef-50a6-44fb-aa60-d3130b48aa65 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:43.538746 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:43.539357 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:43.539638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:43.540177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:43.549970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:43.551441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:43.561491 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1365/2699] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:43.830099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:43.831549 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:43.844600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c777f-e637-486a-97e9-fac13a6c5b6c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:43.849518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:43.850153 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:43.850427 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:43.850700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] PATH_INFO: `/v3/projects/c7e3ef8c63944e6bb0cd645fdc37527d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:43.851809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e3ef8c63944e6bb0cd645fdc37527d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:43.854224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:43.900969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e3ef8c63944e6bb0cd645fdc37527d', 'request_id': 'req-9f5bd107-c42e-470d-93fe-b6592886256b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.908858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e3ef8c63944e6bb0cd645fdc37527d', 'request_id': 'req-9f5bd107-c42e-470d-93fe-b6592886256b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.915279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e3ef8c63944e6bb0cd645fdc37527d', 'request_id': 'req-9f5bd107-c42e-470d-93fe-b6592886256b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.925878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] The token cache is being invalidate because project c7e3ef8c63944e6bb0cd645fdc37527d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:43.926165 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.926809 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:43.928520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1335/2700] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:43 2022] DELETE /identity/v3/projects/c7e3ef8c63944e6bb0cd645fdc37527d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:43.932793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:43.942999 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a94c3-3819-47f6-9097-5bdbd01a2392 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.001218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.001909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.002127 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.002413 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] PATH_INFO: `/v3/users/360dc4936af24c7982579f6dd8f7564f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.003524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=360dc4936af24c7982579f6dd8f7564f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.005468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.050759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360dc4936af24c7982579f6dd8f7564f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.051523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360dc4936af24c7982579f6dd8f7564f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.058236 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360dc4936af24c7982579f6dd8f7564f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.062364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:44.072156 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360dc4936af24c7982579f6dd8f7564f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.073282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4de13c49-c70e-4101-ad7e-2e815439e1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360dc4936af24c7982579f6dd8f7564f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.092822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1366/2701] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:43 2022] DELETE /identity/v3/users/360dc4936af24c7982579f6dd8f7564f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:44.370170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.372140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:44.388666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bd107-c42e-470d-93fe-b6592886256b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.409450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:44.456732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.457401 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.457676 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.457943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] PATH_INFO: `/v3/projects/636287c2b9e54e66ab935a340165f660` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.459059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636287c2b9e54e66ab935a340165f660)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.460939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.516391 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636287c2b9e54e66ab935a340165f660', 'request_id': 'req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.524432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636287c2b9e54e66ab935a340165f660', 'request_id': 'req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.531097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636287c2b9e54e66ab935a340165f660', 'request_id': 'req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.542350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] The token cache is being invalidate because project 636287c2b9e54e66ab935a340165f660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:44.542596 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.543226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4687fb70-6c6f-4d93-86b5-58e8a33bd8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:44.545247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1336/2702] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:44 2022] DELETE /identity/v3/projects/636287c2b9e54e66ab935a340165f660 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:44.550078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.550496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.550874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.573021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:44.574295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:44.636855 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1367/2703] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:44.646731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.647189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.647599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.670425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:44.671966 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:44.680024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1337/2704] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:44.684502 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.694893 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b4719-d3df-4756-958a-bb4f12efb1df None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.699662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.700813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.701167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.701467 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.702117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:44.702422 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.704421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.718809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1368/2705] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:44.723521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.734265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72725c-239d-427e-bb20-ce80a9dd2a2d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.740173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.740761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.741036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.741352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.741982 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.743877 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.774084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1338/2706] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:44 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:44.778936 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.788966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb968ff-b935-4702-82c7-b8d5c711734a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.849124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.849786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.850072 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.850348 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.850988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.853079 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.873675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1369/2707] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:44 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:44.877853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.889684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b0200-44b9-4752-8e15-a5aa43381cb5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.897013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.897745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.898151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.898498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.899272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.901407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.912733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1339/2708] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:44.917015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.926815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa0c87-91ec-444c-899e-917d01c9d182 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.931392 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399e632-1308-4da7-a82b-06c12994022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.931986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e632-1308-4da7-a82b-06c12994022c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.932263 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e632-1308-4da7-a82b-06c12994022c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.932536 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399e632-1308-4da7-a82b-06c12994022c admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.933206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399e632-1308-4da7-a82b-06c12994022c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.935351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399e632-1308-4da7-a82b-06c12994022c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.945919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1370/2709] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:44.950668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:44.962209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b86f7-c0ab-48d6-92e5-c1d6e0865b02 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:44.967569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:44.968224 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:44.968510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:44.968785 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] PATH_INFO: `/v3/projects/de366b96801842b0baf328ad715fc63a/users/13d4621fb7474f11814a4bb9ce05301a/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:44.983786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de366b96801842b0baf328ad715fc63a, user_id=13d4621fb7474f11814a4bb9ce05301a, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:44.986621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:44.999226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1340/2710] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:44 2022] PUT /identity/v3/projects/de366b96801842b0baf328ad715fc63a/users/13d4621fb7474f11814a4bb9ce05301a/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:45.009621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.009889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.010165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.037744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] MFA Rules not processed for user `13d4621fb7474f11814a4bb9ce05301a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:45.038953 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:45.071199 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:45.105258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1371/2711] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:45.110442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.163569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:45.176440 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f0625-aabf-45a3-9561-65ff0d8daef3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.181135 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.181760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.182059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.182318 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.182948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.185530 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.213572 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1341/2712] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:45 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:45.216725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.227339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82989fdf-78e8-4aa8-ac34-bed5c6438350 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.283353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.283958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.284237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.284517 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.285159 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.287074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.309958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1372/2713] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:45 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:45.313992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.324355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e1a24-5d22-40b8-9561-23dabe3196e1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.329288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.329890 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.330172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.330448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.331088 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.332674 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.343373 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1342/2714] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:45.347471 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.358101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e0b4-a8da-4e87-9471-a28b7c909f01 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.362795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97179ff3-f9f3-4293-a941-e2584c68c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.363386 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179ff3-f9f3-4293-a941-e2584c68c88d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.363667 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179ff3-f9f3-4293-a941-e2584c68c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.363944 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97179ff3-f9f3-4293-a941-e2584c68c88d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.364593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97179ff3-f9f3-4293-a941-e2584c68c88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.366227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97179ff3-f9f3-4293-a941-e2584c68c88d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.376621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1373/2715] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:45.380713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.390742 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885d636-b4ea-4ec9-9e14-074174ecf584 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.395443 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.396101 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.396382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.396659 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] PATH_INFO: `/v3/projects/9f5210df49a44a00b9d5110de5d5f626/users/361bd622fff149c1ae2ee66c3049cca8/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.411609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5210df49a44a00b9d5110de5d5f626, user_id=361bd622fff149c1ae2ee66c3049cca8, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.414359 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.428608 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1343/2716] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:45 2022] PUT /identity/v3/projects/9f5210df49a44a00b9d5110de5d5f626/users/361bd622fff149c1ae2ee66c3049cca8/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:45.439531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.439817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.440093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.467865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] MFA Rules not processed for user `361bd622fff149c1ae2ee66c3049cca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:45.469091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:45.532538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1374/2717] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:45.537234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.598857 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854588ed-9452-4add-9b5d-912e4b08eca9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.603453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.604061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.604337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.604610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.605269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.607761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.634981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1344/2718] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:45 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:45.639611 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.650534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b4500-a08d-4572-a36e-016217a15fef None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.690302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:45.707560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.708201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.708484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.708760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.709411 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.711334 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.732445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1375/2719] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:45 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:45.736458 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.747322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567727a-06e0-48ab-93e2-7f9dc4f2ae4b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.752200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.752796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.753078 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.753384 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.754024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.755697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.766614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1345/2720] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:45.770384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.782837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913852b-e85e-4650-928c-78bc72ed08bf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.787641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.788306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.788586 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.788859 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] PATH_INFO: `/v3/projects/ed496c0d102c462b971ba5c3ff4668cb/users/4233fdfd00a54855b93225970ea0ff55/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.806073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed496c0d102c462b971ba5c3ff4668cb, user_id=4233fdfd00a54855b93225970ea0ff55, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.808737 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.828417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1376/2721] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:45 2022] PUT /identity/v3/projects/ed496c0d102c462b971ba5c3ff4668cb/users/4233fdfd00a54855b93225970ea0ff55/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:45.832312 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.842796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb063c-4e2e-4a66-b3fb-383aa38808e3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.905564 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604f44d-ccb4-4343-a03e-80725293eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.906386 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f44d-ccb4-4343-a03e-80725293eddc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.906788 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f44d-ccb4-4343-a03e-80725293eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.907129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604f44d-ccb4-4343-a03e-80725293eddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.907855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604f44d-ccb4-4343-a03e-80725293eddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.909595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604f44d-ccb4-4343-a03e-80725293eddc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.920376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1346/2722] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:45.924431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:45.935468 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc4349-d98f-42bd-9f52-a09609e38098 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:45.940232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:45.940880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:45.941185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:45.941456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] PATH_INFO: `/v3/projects/ed496c0d102c462b971ba5c3ff4668cb/users/4233fdfd00a54855b93225970ea0ff55/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:45.943324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed496c0d102c462b971ba5c3ff4668cb, user_id=4233fdfd00a54855b93225970ea0ff55, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:45.945952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:45.957395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1377/2723] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:45 2022] PUT /identity/v3/projects/ed496c0d102c462b971ba5c3ff4668cb/users/4233fdfd00a54855b93225970ea0ff55/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:46.025880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:46.026173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:46.026457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:46.048388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:46.057499 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] MFA Rules not processed for user `4233fdfd00a54855b93225970ea0ff55`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:46.058790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:46.136246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1347/2724] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:46.149255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:46.151019 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:46.217201 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39433f4a-8b60-406c-8d66-4748d27df38e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:46.218980 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:46.219599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:46.219880 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:46.220152 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:46.280408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:46.281895 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:46.291801 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1378/2725] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:47.824477 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:47.834407 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3398c-6f5c-4fb6-bb92-f15828a9c3bb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:47.838006 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2914c8d-a302-4c61-967c-656084ded9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:47.838610 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2914c8d-a302-4c61-967c-656084ded9ff service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:47.838886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2914c8d-a302-4c61-967c-656084ded9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:47.839155 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2914c8d-a302-4c61-967c-656084ded9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:47.900885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2914c8d-a302-4c61-967c-656084ded9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:47.902369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2914c8d-a302-4c61-967c-656084ded9ff service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:47.912376 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1348/2726] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:47.956809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:47.958546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:48.010157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:48.029875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada667-f256-4e0e-9033-2bda6a82b19f service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:48.034431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:48.035115 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:48.035396 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:48.035668 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] PATH_INFO: `/v3/users/20e3a30a7ede45faae4115c8448a2168` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:48.036839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e3a30a7ede45faae4115c8448a2168)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:48.038779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:48.087601 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e3a30a7ede45faae4115c8448a2168'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.088264 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e3a30a7ede45faae4115c8448a2168'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.095875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e3a30a7ede45faae4115c8448a2168'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.103829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e3a30a7ede45faae4115c8448a2168'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.104475 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e3a30a7ede45faae4115c8448a2168'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.125772 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1379/2727] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:47 2022] DELETE /identity/v3/users/20e3a30a7ede45faae4115c8448a2168 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:48.130185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:48.130478 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:48.130775 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:48.150640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:48.151853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:48.214510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1349/2728] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:48.224835 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:48.226671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:48.321397 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f573e-a99b-40cb-bc66-4616e7077663 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:48.326651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:48.327328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:48.327697 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:48.328037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:48.342646 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:48.344207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:48.358134 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1380/2729] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:48.513392 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:48.515687 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:48.560343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:48.580720 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221034a-3b04-4f94-bfc8-a18f49bed3a5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:48.584614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:48.585514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:48.585514 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:48.585791 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:48.594339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:48.688308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:48.689827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:48.703808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1350/2730] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:48.723133 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:48.724645 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:48.739614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b550b-be64-47a6-96c0-ed24e91fc5bb service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:48.745346 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:48.746051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:48.746361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:48.747200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] PATH_INFO: `/v3/projects/85430f6b99a949d0a49acab18b44017e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:48.748503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85430f6b99a949d0a49acab18b44017e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:48.751862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:48.808899 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85430f6b99a949d0a49acab18b44017e', 'request_id': 'req-84a86535-3400-4049-85c8-460b4c291f3f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.815582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85430f6b99a949d0a49acab18b44017e', 'request_id': 'req-84a86535-3400-4049-85c8-460b4c291f3f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.824165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85430f6b99a949d0a49acab18b44017e', 'request_id': 'req-84a86535-3400-4049-85c8-460b4c291f3f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.825448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:48.837973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] The token cache is being invalidate because project 85430f6b99a949d0a49acab18b44017e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:48.838265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.838909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.840898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1381/2731] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:48 2022] DELETE /identity/v3/projects/85430f6b99a949d0a49acab18b44017e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:48.844948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:48.855250 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65ab4c-b671-43d6-9c1e-9384e2b7d584 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:48.911846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:48.912398 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:48.912678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:48.912948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] PATH_INFO: `/v3/users/4591062886a14955a4144f4106105db2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:48.914111 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4591062886a14955a4144f4106105db2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:48.916282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:48.962121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4591062886a14955a4144f4106105db2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.962790 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4591062886a14955a4144f4106105db2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.970592 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4591062886a14955a4144f4106105db2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.983870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4591062886a14955a4144f4106105db2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.984521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-169b0796-9874-45df-bb2f-82f56273f033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4591062886a14955a4144f4106105db2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:48.996422 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1351/2732] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:48 2022] DELETE /identity/v3/users/4591062886a14955a4144f4106105db2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:49.468080 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:49.469596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:49.482568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a86535-3400-4049-85c8-460b4c291f3f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:49.576117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:49.576916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:49.577274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:49.577558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] PATH_INFO: `/v3/projects/769873e61ae94e80a10c1ab99f70c53c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:49.578718 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769873e61ae94e80a10c1ab99f70c53c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:49.580837 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:49.642037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769873e61ae94e80a10c1ab99f70c53c', 'request_id': 'req-65fe6651-43c0-4f38-bf50-c6def05beb90'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:49.649589 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769873e61ae94e80a10c1ab99f70c53c', 'request_id': 'req-65fe6651-43c0-4f38-bf50-c6def05beb90'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:49.662929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769873e61ae94e80a10c1ab99f70c53c', 'request_id': 'req-65fe6651-43c0-4f38-bf50-c6def05beb90'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:49.682543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] The token cache is being invalidate because project 769873e61ae94e80a10c1ab99f70c53c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:49.683088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:49.684655 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-65fe6651-43c0-4f38-bf50-c6def05beb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:49.686501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1382/2733] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:49 2022] DELETE /identity/v3/projects/769873e61ae94e80a10c1ab99f70c53c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:49.691525 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:49.691811 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:49.692104 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:49.702958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:49.716029 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:49.717408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:49.780599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1352/2734] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:49.788437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:49.789232 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:49.789597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:49.811497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:49.812810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:49.825278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1383/2735] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:49.830408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:49.842171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dd331-fe03-4f65-9b9f-01ceb612ee59 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:49.846830 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:49.847463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:49.847744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:49.848014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:49.848688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:49.848986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:49.850642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:49.864613 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1353/2736] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:49.868572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:49.878525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e51af-8cac-44da-a8e8-22ea3494f36f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:49.883305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:49.883908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:49.884187 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:49.884458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:49.885089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:49.887001 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:49.922567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1384/2737] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:49.926727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:49.936850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f33182-be0d-4b0f-9b9e-d7b9cdb6055a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:50.003420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:50.004030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.004321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.004582 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.005247 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:50.007587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:50.036220 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1354/2738] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:49 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:50.040637 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:50.069449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55382f3-175f-443e-9a0b-6d9dc945aca4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:50.081048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:50.081048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.081048 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.081472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.088177 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:50.089640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:50.110924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1385/2739] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:50.118617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:50.148756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fb250-cfff-49d1-a5e4-15dd8e29bc6a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:50.169236 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb4b8-22e2-45dc-ab10-1754b422f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:50.169867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb4b8-22e2-45dc-ab10-1754b422f4af admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.170147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb4b8-22e2-45dc-ab10-1754b422f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.170419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb4b8-22e2-45dc-ab10-1754b422f4af admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.171073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdb4b8-22e2-45dc-ab10-1754b422f4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:50.181215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdb4b8-22e2-45dc-ab10-1754b422f4af admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:50.209712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1355/2740] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:50.213970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:50.228060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bfea6-ab79-4306-9aa9-33c68fc86584 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:50.234950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:50.235978 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.236449 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.236910 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] PATH_INFO: `/v3/projects/d6b2fb2a297a40fea543e397acb783d6/users/5d2e382efa3c428fb3b452399c63fd0b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.261319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b2fb2a297a40fea543e397acb783d6, user_id=5d2e382efa3c428fb3b452399c63fd0b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:50.264593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:50.290340 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1386/2741] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:50 2022] PUT /identity/v3/projects/d6b2fb2a297a40fea543e397acb783d6/users/5d2e382efa3c428fb3b452399c63fd0b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:50.302974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.303265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.303540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.312854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:50.316051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:50.343349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:50.344245 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] MFA Rules not processed for user `5d2e382efa3c428fb3b452399c63fd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:50.345850 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:50.409026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71429626-2a8f-4eb6-8dfb-caa48b5ca9cd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:50.415196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:50.416032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.416488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.416826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.419566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:50.426295 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:50.431192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1356/2742] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:50.439333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:50.441004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:50.444234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:50.445802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:50.453547 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1387/2743] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:50.519120 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3a1a-22bf-458d-b06b-ade85087e5ca None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:50.521012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9f050-9cb6-46a1-b73d-906f9e30bc4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:50.521666 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f050-9cb6-46a1-b73d-906f9e30bc4f service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:50.521952 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f050-9cb6-46a1-b73d-906f9e30bc4f service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:50.522230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9f050-9cb6-46a1-b73d-906f9e30bc4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:50.532438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9f050-9cb6-46a1-b73d-906f9e30bc4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:50.534299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9f050-9cb6-46a1-b73d-906f9e30bc4f service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:50.544880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1357/2744] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:30:52.698252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:52.700258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:52.766488 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee712407-c6eb-4fe0-b962-fe180781d1fd service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:52.771329 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:52.771954 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:52.772231 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:52.772524 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] PATH_INFO: `/v3/users/13d4621fb7474f11814a4bb9ce05301a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:52.773808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d4621fb7474f11814a4bb9ce05301a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:52.776022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:52.823101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d4621fb7474f11814a4bb9ce05301a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:52.823760 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d4621fb7474f11814a4bb9ce05301a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:52.831839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d4621fb7474f11814a4bb9ce05301a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:52.839574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d4621fb7474f11814a4bb9ce05301a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:52.840886 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d4621fb7474f11814a4bb9ce05301a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:52.868437 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1388/2745] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:52 2022] DELETE /identity/v3/users/13d4621fb7474f11814a4bb9ce05301a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:52.873234 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:52.873713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:52.873955 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:52.893038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:52.894265 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:52.952942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1358/2746] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:30:52.962656 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:52.964037 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:52.995754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:53.022684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86354632-bb40-49b6-a394-44b154007d79 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:53.026333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:53.026932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:53.027210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:53.027483 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:53.037136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:53.038570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:53.048116 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1389/2747] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:53.327218 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:53.328748 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:53.341565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afafa2-ea33-4383-a5e7-95cca812a5af None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:53.346271 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:53.347389 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:53.347691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:53.348145 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] PATH_INFO: `/v3/projects/de366b96801842b0baf328ad715fc63a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:53.349311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de366b96801842b0baf328ad715fc63a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:53.351243 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:53.399226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de366b96801842b0baf328ad715fc63a', 'request_id': 'req-5371cbe8-93a9-48cf-845f-6a6973879d0f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.406562 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de366b96801842b0baf328ad715fc63a', 'request_id': 'req-5371cbe8-93a9-48cf-845f-6a6973879d0f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.413766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de366b96801842b0baf328ad715fc63a', 'request_id': 'req-5371cbe8-93a9-48cf-845f-6a6973879d0f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.426473 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] The token cache is being invalidate because project de366b96801842b0baf328ad715fc63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:53.426829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.427497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.429276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1359/2748] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:53 2022] DELETE /identity/v3/projects/de366b96801842b0baf328ad715fc63a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:53.433330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:53.444220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a5ef4-f70b-4841-92f0-86bd04da2540 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:53.500496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:53.501044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:53.501353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:53.501626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] PATH_INFO: `/v3/users/361bd622fff149c1ae2ee66c3049cca8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:53.502768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] RBAC: Authorizing `identity:delete_user(user_id=361bd622fff149c1ae2ee66c3049cca8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:53.504704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:53.548941 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361bd622fff149c1ae2ee66c3049cca8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.549618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361bd622fff149c1ae2ee66c3049cca8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.556335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361bd622fff149c1ae2ee66c3049cca8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.563673 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361bd622fff149c1ae2ee66c3049cca8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.564338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361bd622fff149c1ae2ee66c3049cca8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:53.581417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1390/2749] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:53 2022] DELETE /identity/v3/users/361bd622fff149c1ae2ee66c3049cca8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:53.879538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:53.881004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:53.896276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cbe8-93a9-48cf-845f-6a6973879d0f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:53.923179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:53.957721 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:53.958351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:53.958646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:53.958923 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] PATH_INFO: `/v3/projects/9f5210df49a44a00b9d5110de5d5f626` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:53.960038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5210df49a44a00b9d5110de5d5f626)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:53.962018 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:54.014708 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5210df49a44a00b9d5110de5d5f626', 'request_id': 'req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.022026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5210df49a44a00b9d5110de5d5f626', 'request_id': 'req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.029581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5210df49a44a00b9d5110de5d5f626', 'request_id': 'req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.040529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] The token cache is being invalidate because project 9f5210df49a44a00b9d5110de5d5f626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:54.040818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.041595 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.043956 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1360/2750] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:53 2022] DELETE /identity/v3/projects/9f5210df49a44a00b9d5110de5d5f626 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:54.048497 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:54.049979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:54.063840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee12b80-5688-459e-80ec-e419baa0164f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:54.116585 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:54.128426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:54.129062 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.129375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.129649 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] PATH_INFO: `/v3/users/4233fdfd00a54855b93225970ea0ff55` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.130892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4233fdfd00a54855b93225970ea0ff55)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:54.132839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:54.180351 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4233fdfd00a54855b93225970ea0ff55'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.181026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4233fdfd00a54855b93225970ea0ff55'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.190039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4233fdfd00a54855b93225970ea0ff55'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.198450 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4233fdfd00a54855b93225970ea0ff55'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.199074 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fdf954be-2508-43a5-8b85-40d26bb4ca71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4233fdfd00a54855b93225970ea0ff55'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.217924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1391/2751] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:54 2022] DELETE /identity/v3/users/4233fdfd00a54855b93225970ea0ff55 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:54.493459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:54.495584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:54.521370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80ac5c-9e2a-418a-be71-25fb6ea00f2e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:54.578333 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:54.578874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.579148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.579414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] PATH_INFO: `/v3/projects/ed496c0d102c462b971ba5c3ff4668cb` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.580505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed496c0d102c462b971ba5c3ff4668cb)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:54.582419 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:54.635700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed496c0d102c462b971ba5c3ff4668cb', 'request_id': 'req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.644461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed496c0d102c462b971ba5c3ff4668cb', 'request_id': 'req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.646409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:54.651760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed496c0d102c462b971ba5c3ff4668cb', 'request_id': 'req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.663451 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] The token cache is being invalidate because project ed496c0d102c462b971ba5c3ff4668cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:54.663744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.664382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5f6c4e1c-7f82-47f2-b9c3-85fed1145fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:54.666154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1361/2752] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:54 2022] DELETE /identity/v3/projects/ed496c0d102c462b971ba5c3ff4668cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:54.671121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.671414 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.671695 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.691974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:54.693216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:54.751992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1392/2753] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:54.762126 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.762470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.762800 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.783883 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:54.785258 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:54.794175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1362/2754] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:54.798515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:54.808123 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da176d-b8eb-4ac1-8722-d775b69a4e4f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:54.813423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:54.814011 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.814289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.814560 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.815194 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:54.815492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:54.817136 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:54.829068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1393/2755] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:54.833526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:54.843026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164962c-f168-41bb-8c02-bb5dc4de1902 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:54.847671 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:54.848269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.848548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.848821 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.849502 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:54.851395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:54.880784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1363/2756] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:54 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:54.884771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:54.895051 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736a8e-6766-47d1-8928-25084d6b95af admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:54.954682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:54.963423 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:54.964192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:54.964723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:54.965053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:54.966301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:54.968398 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:54.985640 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:54.987325 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:54.990463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1394/2757] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:54 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:54.994445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:55.004544 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ec373-7150-478d-8911-990de99a7d7d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:55.009208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:55.009786 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:55.010060 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:55.010328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:55.010958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:55.012613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:55.022596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1395/2758] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:55.026406 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:55.035975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe53e5-a22e-451d-8ea4-635e331dfb5a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:55.040840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:55.047323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:55.047323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:55.047323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:55.047323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:55.047323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:55.056004 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad53657-0e18-4435-bdd6-76692cd6ce78 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:55.059940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1396/2759] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:55.060867 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:55.061853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:55.062690 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:55.062968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:55.063240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:55.065064 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:55.072862 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dac921-6036-41f7-a196-5c550b52922d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:55.078210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:55.078636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:55.078866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:55.079206 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:55.079426 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] PATH_INFO: `/v3/projects/ecc7e7495237497b981d82274819c2bf/users/c83c14b5bb1c41d9b7cc27b6947b1550/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:55.080089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b4e2f-16d6-4d7e-bd8d-0f07baad75cc service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:55.089867 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1364/2760] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:30:55.094207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc7e7495237497b981d82274819c2bf, user_id=c83c14b5bb1c41d9b7cc27b6947b1550, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:55.096839 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:55.111321 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1397/2761] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:55 2022] PUT /identity/v3/projects/ecc7e7495237497b981d82274819c2bf/users/c83c14b5bb1c41d9b7cc27b6947b1550/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:55.123152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:55.123437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:55.123738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:55.154327 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] MFA Rules not processed for user `c83c14b5bb1c41d9b7cc27b6947b1550`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:55.155558 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:55.223771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1365/2762] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:55.237556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:55.239700 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:55.326084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d238d-2636-4a58-87db-a6f14dee1b7d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:55.329829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:55.330355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:55.330633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:55.330908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:55.339184 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:55.340808 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:55.349675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1398/2763] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:30:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:30:58.487614 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:58.489045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:58.544086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:58.561466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e125fec-51b0-49ae-bf09-b2b89bb6d97f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:58.566441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:58.567119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:58.567415 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:58.567688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] PATH_INFO: `/v3/users/45416134d3204770a6ddc7f61538fc3c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:58.568794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45416134d3204770a6ddc7f61538fc3c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:58.570840 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:58.621933 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45416134d3204770a6ddc7f61538fc3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:58.622699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45416134d3204770a6ddc7f61538fc3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:58.629848 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45416134d3204770a6ddc7f61538fc3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:58.642381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45416134d3204770a6ddc7f61538fc3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:58.643026 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-622d11c1-76ff-4fdf-aac2-f0d70b710759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45416134d3204770a6ddc7f61538fc3c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:58.657864 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1366/2764] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:30:58 2022] DELETE /identity/v3/users/45416134d3204770a6ddc7f61538fc3c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:58.854021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:58.866796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3909dc-8465-4552-b0d8-9fe08d2d2e0f service glance] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:58.927126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:58.927767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:58.928046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:58.928320 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] PATH_INFO: `/v3/projects/1be4743d20cb4c39b4d549d23cdbd7d6` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:58.929452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be4743d20cb4c39b4d549d23cdbd7d6)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:58.931339 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:58.981394 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:58.983914 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be4743d20cb4c39b4d549d23cdbd7d6', 'request_id': 'req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:58.990986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be4743d20cb4c39b4d549d23cdbd7d6', 'request_id': 'req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:59.000015 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be4743d20cb4c39b4d549d23cdbd7d6', 'request_id': 'req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:59.012408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] The token cache is being invalidate because project 1be4743d20cb4c39b4d549d23cdbd7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:30:59.012408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:59.012832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dbec14ac-ff84-4c60-bbe8-c868f5ac3c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:30:59.014461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1399/2765] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:30:58 2022] DELETE /identity/v3/projects/1be4743d20cb4c39b4d549d23cdbd7d6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:30:59.019434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.019722 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.020001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.041678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:59.042898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:59.238445 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1367/2766] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:59.246591 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.246875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.247153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.267322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:59.268621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:59.276907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1400/2767] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:59.282084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.291986 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cc501-30ad-468d-b718-dc2f460728a8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.297214 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.297812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.298087 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.298357 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.298997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:59.299294 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.300858 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.313084 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1368/2768] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:30:59.317807 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.327540 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd4df5-3c51-4650-a487-212a2a1f146b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.332102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.332689 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.332998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.333298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.333921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.335842 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.362658 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1401/2769] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:59.366954 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.377996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6bab0-3ecf-4841-ac9a-653853cda343 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.433094 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:59.440452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.441421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.441854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.442210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.443063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.445449 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.469719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1369/2770] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:30:59.471330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.482209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f153d5-62ac-499b-b17c-abb2f100768b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.486998 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.487487 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.487850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.488026 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.488733 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.490349 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.501097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1402/2771] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:59.505286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.517528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff71264-1d6e-42ac-a9b2-eb795eec4b68 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.522631 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25967a2-ff1d-46fa-a672-0879d661acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.523424 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25967a2-ff1d-46fa-a672-0879d661acdc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.523704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25967a2-ff1d-46fa-a672-0879d661acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.523974 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25967a2-ff1d-46fa-a672-0879d661acdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.524616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25967a2-ff1d-46fa-a672-0879d661acdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.526211 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25967a2-ff1d-46fa-a672-0879d661acdc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.537298 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1370/2772] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:30:59.541684 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.552120 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9b71e-23c8-487e-b871-7c12305f381c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.556989 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.557662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.557952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.558213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] PATH_INFO: `/v3/projects/eeb91558bbfd4436bf975bb7557127c9/users/4f85412f58b34bcf9d5842b7b076a849/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.574884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb91558bbfd4436bf975bb7557127c9, user_id=4f85412f58b34bcf9d5842b7b076a849, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.577730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.596188 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1403/2773] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:59 2022] PUT /identity/v3/projects/eeb91558bbfd4436bf975bb7557127c9/users/4f85412f58b34bcf9d5842b7b076a849/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:59.606894 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.607202 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.607470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.635719 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] MFA Rules not processed for user `4f85412f58b34bcf9d5842b7b076a849`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:59.637508 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:59.703162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1371/2774] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:30:59.707813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.783417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083568-2696-420e-8d77-d037002cd71c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.788341 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.788959 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.789274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.789550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.790458 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.792565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.822715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1404/2775] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:59.823859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.835302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d218-f8bd-428d-8a39-b1ab4a93c4e6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.897969 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.898593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.898870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.899140 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.899778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.902097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.925939 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1372/2776] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:30:59 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:59.929901 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.940273 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936e673-f307-4314-94b1-09e4de035953 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.944881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.945513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.945789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.946061 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.946714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.948303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:59.960268 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1405/2777] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:30:59.964463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:59.974943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c9eff-527f-4dd7-922b-66e4a6294415 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:59.979700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:59.980349 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:59.980647 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:59.981725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] PATH_INFO: `/v3/projects/aac55cba03114180bf29f64f3dd805f8/users/75b78e5292884677a0079c5e8fe9d4c7/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:59.996178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac55cba03114180bf29f64f3dd805f8, user_id=75b78e5292884677a0079c5e8fe9d4c7, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:59.998799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:00.016565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1373/2778] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:30:59 2022] PUT /identity/v3/projects/aac55cba03114180bf29f64f3dd805f8/users/75b78e5292884677a0079c5e8fe9d4c7/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:00.020597 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:00.031894 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b8a8b-3e6a-49d9-b272-a90728310611 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:00.089297 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:00.105402 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf420ae-3737-4236-9944-e3a7c7e79042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:00.106739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf420ae-3737-4236-9944-e3a7c7e79042 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:00.107022 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf420ae-3737-4236-9944-e3a7c7e79042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:00.107292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf420ae-3737-4236-9944-e3a7c7e79042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:00.107927 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf420ae-3737-4236-9944-e3a7c7e79042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:00.109556 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf420ae-3737-4236-9944-e3a7c7e79042 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:00.119306 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1406/2779] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:00.124337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:00.134633 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45417-763e-4487-b3ef-522b957712d7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:00.139967 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:00.140622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:00.140899 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:00.141210 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] PATH_INFO: `/v3/projects/aac55cba03114180bf29f64f3dd805f8/users/75b78e5292884677a0079c5e8fe9d4c7/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:00.143180 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac55cba03114180bf29f64f3dd805f8, user_id=75b78e5292884677a0079c5e8fe9d4c7, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:00.145853 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:00.157232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1374/2780] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:00 2022] PUT /identity/v3/projects/aac55cba03114180bf29f64f3dd805f8/users/75b78e5292884677a0079c5e8fe9d4c7/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:00.170032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244fe9-60ce-430a-be19-827136f801aa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:00.170323 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244fe9-60ce-430a-be19-827136f801aa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:00.170599 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02244fe9-60ce-430a-be19-827136f801aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:00.199365 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-02244fe9-60ce-430a-be19-827136f801aa None None] MFA Rules not processed for user `75b78e5292884677a0079c5e8fe9d4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:00.201492 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-02244fe9-60ce-430a-be19-827136f801aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:00.279929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1407/2781] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:00.291587 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:00.293827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:00.317753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:00.376802 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc8ae0-8e16-4dd2-9ed6-5d24796f78d6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:00.380710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943c0ae-0e73-4c70-a05e-098688165872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:00.381350 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c0ae-0e73-4c70-a05e-098688165872 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:00.381632 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c0ae-0e73-4c70-a05e-098688165872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:00.381924 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943c0ae-0e73-4c70-a05e-098688165872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:00.390976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c0ae-0e73-4c70-a05e-098688165872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:00.392404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943c0ae-0e73-4c70-a05e-098688165872 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:00.401711 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1375/2782] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:00.815428 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02244fe9-60ce-430a-be19-827136f801aa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:00.879496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02244fe9-60ce-430a-be19-827136f801aa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:00.883958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:00.884610 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:00.884884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:00.885178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] PATH_INFO: `/v3/users/4f85412f58b34bcf9d5842b7b076a849` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:00.886286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f85412f58b34bcf9d5842b7b076a849)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:00.888235 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:00.935621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f85412f58b34bcf9d5842b7b076a849'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:00.936274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f85412f58b34bcf9d5842b7b076a849'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:00.942963 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f85412f58b34bcf9d5842b7b076a849'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:00.950144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f85412f58b34bcf9d5842b7b076a849'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:00.950749 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f85412f58b34bcf9d5842b7b076a849'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:00.955143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:00.971732 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1408/2783] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:00 2022] DELETE /identity/v3/users/4f85412f58b34bcf9d5842b7b076a849 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:00.976178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:00.976695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:00.976695 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:00.996675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:00.998063 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:01.057855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1376/2784] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:01.068010 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:01.069479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:01.140393 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef5e38-6538-42e3-905b-facd8d48f7c9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:01.145371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:01.146210 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:01.146496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:01.147096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:01.158317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:01.159745 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:01.170789 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1409/2785] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:01.469831 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:01.471356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:01.488689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de106807-94eb-49fb-ad42-cec11c74d8bb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:01.494305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:01.494948 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:01.495229 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:01.495505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] PATH_INFO: `/v3/projects/eeb91558bbfd4436bf975bb7557127c9` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:01.496668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb91558bbfd4436bf975bb7557127c9)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:01.498594 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:01.548750 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb91558bbfd4436bf975bb7557127c9', 'request_id': 'req-167334b8-b2d5-40af-9efa-a6829ca71fa2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.557400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb91558bbfd4436bf975bb7557127c9', 'request_id': 'req-167334b8-b2d5-40af-9efa-a6829ca71fa2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.565035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb91558bbfd4436bf975bb7557127c9', 'request_id': 'req-167334b8-b2d5-40af-9efa-a6829ca71fa2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.576076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] The token cache is being invalidate because project eeb91558bbfd4436bf975bb7557127c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:01.576309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.577050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.579567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1377/2786] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:01 2022] DELETE /identity/v3/projects/eeb91558bbfd4436bf975bb7557127c9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:01.583644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:01.594130 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0e02b-8421-4df3-bc70-d243a8af9264 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:01.661504 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:01.662140 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:01.662424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:01.662702 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] PATH_INFO: `/v3/users/75b78e5292884677a0079c5e8fe9d4c7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:01.663820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b78e5292884677a0079c5e8fe9d4c7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:01.666032 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:01.718198 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b78e5292884677a0079c5e8fe9d4c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.719344 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b78e5292884677a0079c5e8fe9d4c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.730688 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b78e5292884677a0079c5e8fe9d4c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.738827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b78e5292884677a0079c5e8fe9d4c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.739546 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-040a94df-4135-4d61-bad0-1b20284a5522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b78e5292884677a0079c5e8fe9d4c7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:01.757983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1410/2787] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:01 2022] DELETE /identity/v3/users/75b78e5292884677a0079c5e8fe9d4c7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:31:02.037670 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.039472 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:02.055656 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167334b8-b2d5-40af-9efa-a6829ca71fa2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.077847 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:02.119521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.120200 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.120483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.120758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] PATH_INFO: `/v3/projects/aac55cba03114180bf29f64f3dd805f8` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.122718 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac55cba03114180bf29f64f3dd805f8)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.124680 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.173323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac55cba03114180bf29f64f3dd805f8', 'request_id': 'req-709e73b7-a8a3-49ec-8901-26cb5919cd1d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:02.180699 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac55cba03114180bf29f64f3dd805f8', 'request_id': 'req-709e73b7-a8a3-49ec-8901-26cb5919cd1d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:02.187978 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac55cba03114180bf29f64f3dd805f8', 'request_id': 'req-709e73b7-a8a3-49ec-8901-26cb5919cd1d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:02.199321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] The token cache is being invalidate because project aac55cba03114180bf29f64f3dd805f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:02.200125 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:02.200776 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-709e73b7-a8a3-49ec-8901-26cb5919cd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:02.202267 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1378/2788] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:02 2022] DELETE /identity/v3/projects/aac55cba03114180bf29f64f3dd805f8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:02.207926 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.208436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.208538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.222564 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:02.229626 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:02.231621 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:02.292391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1411/2789] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:02.300627 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.300914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.301226 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.320946 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:02.322185 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:02.330622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1379/2790] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:02.334976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.347947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd7f45-2c5a-43e9-9d74-ed9d6cdb774a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.352613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.353253 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.353537 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.353812 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.354463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:02.354768 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.356496 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.370382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1412/2791] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:02.375675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.385747 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d979abd-d356-4528-8a68-4456022eb2fc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.391528 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.392173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.392452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.392723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.393400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.395300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.426707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1380/2792] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:02.431229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.441902 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a323869-ca51-4840-8fa2-86e3db80f294 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.500605 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.501255 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.501541 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.501817 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.502465 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.504427 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.526477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1413/2793] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:02.532179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.542796 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b2997-8621-4b08-b3e9-663a60bf7f47 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.548001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.548600 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.548880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.549191 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.549836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.551420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.561844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1381/2794] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:02.565925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.576976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917788b-b062-46bd-bfb4-075994253165 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.586093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c23d0-3ccb-4a4a-8afa-00b6ed67715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.586929 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c23d0-3ccb-4a4a-8afa-00b6ed67715b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.587202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c23d0-3ccb-4a4a-8afa-00b6ed67715b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.587543 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c23d0-3ccb-4a4a-8afa-00b6ed67715b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.588415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c23d0-3ccb-4a4a-8afa-00b6ed67715b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.590221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c23d0-3ccb-4a4a-8afa-00b6ed67715b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.603384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1414/2795] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:02.608303 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.621274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbd353-4404-4b20-97a4-223ddd4253fe admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.623801 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.624607 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.624885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.625180 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] PATH_INFO: `/v3/projects/1fbca0d5675f43f2b65b58217819d8eb/users/7802ddb7ccf8440ca398d8d3287738a2/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.641300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fbca0d5675f43f2b65b58217819d8eb, user_id=7802ddb7ccf8440ca398d8d3287738a2, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.643970 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.657693 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1382/2796] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:02 2022] PUT /identity/v3/projects/1fbca0d5675f43f2b65b58217819d8eb/users/7802ddb7ccf8440ca398d8d3287738a2/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:02.669266 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.669654 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.669933 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.698548 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] MFA Rules not processed for user `7802ddb7ccf8440ca398d8d3287738a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:02.700000 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:02.770008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1415/2797] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:02.774629 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.829344 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:02.853664 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb20af7-cc67-44d0-aff1-f078765fdcc0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.858997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.859605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.859882 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.860154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.860779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.862726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.889981 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1383/2798] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:02.894238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:02.899660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:02.907322 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e7d27-4b5a-4a41-af4f-a45188c78208 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:02.965966 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:02.966578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:02.966881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:02.967153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:02.967776 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:02.969825 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:02.993239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1416/2799] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:02 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:02.997818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:03.007808 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a7560-6fe5-43e3-a35c-837306b15bf2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:03.012911 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:03.013522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.013797 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.014061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.014712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:03.016279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:03.026744 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1384/2800] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:31:03.031430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:03.042008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1fa7d-1d12-4cfe-9886-481496cfd0bf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:03.048274 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:03.049312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.049741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.050097 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] PATH_INFO: `/v3/projects/871c022cd7814000a98a85b071b4d153/users/5692c4b7761246d8978a25f090fbd573/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.072167 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=871c022cd7814000a98a85b071b4d153, user_id=5692c4b7761246d8978a25f090fbd573, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:03.075503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:03.091810 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1417/2801] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:03 2022] PUT /identity/v3/projects/871c022cd7814000a98a85b071b4d153/users/5692c4b7761246d8978a25f090fbd573/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:31:03.095906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:03.106137 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eef84c-b4a8-4687-9e53-7586e3342b92 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:03.168679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414bb4a-1923-4317-90c8-e1d5658f5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:03.169243 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414bb4a-1923-4317-90c8-e1d5658f5ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.169529 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414bb4a-1923-4317-90c8-e1d5658f5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.169804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414bb4a-1923-4317-90c8-e1d5658f5ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.170447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414bb4a-1923-4317-90c8-e1d5658f5ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:03.172035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414bb4a-1923-4317-90c8-e1d5658f5ef8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:03.182240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1385/2802] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:03.187064 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:03.199457 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150eb5-4aff-464e-b57d-5d5b001e7cce admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:03.204640 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:03.205330 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.205614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.205892 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] PATH_INFO: `/v3/projects/871c022cd7814000a98a85b071b4d153/users/5692c4b7761246d8978a25f090fbd573/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.207891 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871c022cd7814000a98a85b071b4d153, user_id=5692c4b7761246d8978a25f090fbd573, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:03.210580 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:03.222148 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1418/2803] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:03 2022] PUT /identity/v3/projects/871c022cd7814000a98a85b071b4d153/users/5692c4b7761246d8978a25f090fbd573/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:03.234418 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.234700 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.234976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.264429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] MFA Rules not processed for user `5692c4b7761246d8978a25f090fbd573`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:03.265691 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:03.334901 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1386/2804] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:03.347328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:03.349665 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:03.413102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6ac9d-5380-446d-b37b-805ca69d9591 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:03.416974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:03.417607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.417883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.418739 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.427526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:03.428967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:03.439045 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1419/2805] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:03.541873 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:03.552425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0070e-a38c-480c-9193-e4e083b04ece None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:03.555959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd4ac3-5ad4-48b9-8f2f-4a9a0f0032b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:03.556551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4ac3-5ad4-48b9-8f2f-4a9a0f0032b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:03.556824 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4ac3-5ad4-48b9-8f2f-4a9a0f0032b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:03.557090 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd4ac3-5ad4-48b9-8f2f-4a9a0f0032b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:03.602745 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:03.616968 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4ac3-5ad4-48b9-8f2f-4a9a0f0032b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:03.618453 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd4ac3-5ad4-48b9-8f2f-4a9a0f0032b5 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:03.636588 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1387/2806] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:06.256171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:06.316928 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:06.321558 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe64a-68d3-498e-a285-2e50e8b73b2a service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:06.328084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:06.329146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:06.329632 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:06.329977 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] PATH_INFO: `/v3/users/7802ddb7ccf8440ca398d8d3287738a2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:06.331129 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7802ddb7ccf8440ca398d8d3287738a2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:06.333132 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:06.385335 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7802ddb7ccf8440ca398d8d3287738a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:06.386025 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7802ddb7ccf8440ca398d8d3287738a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:06.397480 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7802ddb7ccf8440ca398d8d3287738a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:06.406956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7802ddb7ccf8440ca398d8d3287738a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:06.407715 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7802ddb7ccf8440ca398d8d3287738a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:06.427545 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1420/2807] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:06 2022] DELETE /identity/v3/users/7802ddb7ccf8440ca398d8d3287738a2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:06.432112 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:06.432567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:06.432689 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:06.454540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:06.455774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:06.516663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1388/2808] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:06.526284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:06.528680 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:06.587539 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d287-b418-4aaa-9bdd-5229b11ae400 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:06.591887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:06.592534 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:06.592815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:06.593090 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:06.602526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:06.604089 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:06.615262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1421/2809] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:06.909619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:06.911017 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:06.935959 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b96e1-8f5d-4c85-af6e-cae54d8945e4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:06.941677 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:06.942332 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:06.942605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:06.942874 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] PATH_INFO: `/v3/projects/1fbca0d5675f43f2b65b58217819d8eb` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:06.944013 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fbca0d5675f43f2b65b58217819d8eb)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:06.946100 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:06.993362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fbca0d5675f43f2b65b58217819d8eb', 'request_id': 'req-2b5009bd-0875-43e8-b698-68b6acdd7cda'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.001329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fbca0d5675f43f2b65b58217819d8eb', 'request_id': 'req-2b5009bd-0875-43e8-b698-68b6acdd7cda'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.008841 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fbca0d5675f43f2b65b58217819d8eb', 'request_id': 'req-2b5009bd-0875-43e8-b698-68b6acdd7cda'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.020339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] The token cache is being invalidate because project 1fbca0d5675f43f2b65b58217819d8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:07.020571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.021239 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.022710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1389/2810] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:06 2022] DELETE /identity/v3/projects/1fbca0d5675f43f2b65b58217819d8eb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:07.026722 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:07.036317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf848-dc7f-43cb-93b1-9dfb53ead1a1 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:07.094793 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:07.095441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.095725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.096018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] PATH_INFO: `/v3/users/5692c4b7761246d8978a25f090fbd573` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.097301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5692c4b7761246d8978a25f090fbd573)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:07.099225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:07.120864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:07.154486 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5692c4b7761246d8978a25f090fbd573'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.155146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5692c4b7761246d8978a25f090fbd573'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.162100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5692c4b7761246d8978a25f090fbd573'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.170304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5692c4b7761246d8978a25f090fbd573'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.170950 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d42e5ac8-fe65-4c32-b9cb-8f385793a102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5692c4b7761246d8978a25f090fbd573'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.188033 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1422/2811] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:07 2022] DELETE /identity/v3/users/5692c4b7761246d8978a25f090fbd573 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:07.465907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:07.467484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:07.481098 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5009bd-0875-43e8-b698-68b6acdd7cda admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:07.542622 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:07.543787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.544138 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.544404 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] PATH_INFO: `/v3/projects/871c022cd7814000a98a85b071b4d153` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.545560 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=871c022cd7814000a98a85b071b4d153)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:07.547481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:07.558725 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:07.597095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871c022cd7814000a98a85b071b4d153', 'request_id': 'req-f3079a09-0eff-463c-a3dc-caa0c8b279e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.605003 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871c022cd7814000a98a85b071b4d153', 'request_id': 'req-f3079a09-0eff-463c-a3dc-caa0c8b279e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.612442 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871c022cd7814000a98a85b071b4d153', 'request_id': 'req-f3079a09-0eff-463c-a3dc-caa0c8b279e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.623293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] The token cache is being invalidate because project 871c022cd7814000a98a85b071b4d153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:07.623574 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.624233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f3079a09-0eff-463c-a3dc-caa0c8b279e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:07.625737 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1390/2812] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:07 2022] DELETE /identity/v3/projects/871c022cd7814000a98a85b071b4d153 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:07.630657 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.631144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.631248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.650960 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:07.652178 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:07.716627 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1423/2813] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:07.724484 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.724760 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.725033 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.745272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:07.747393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:07.756906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1391/2814] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:07.761220 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:07.770962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329c95-575f-48bc-b716-7dfc7e56b22e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:07.776787 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:07.777811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.778149 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.778570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.779383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:07.779800 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:07.782331 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:07.798972 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1424/2815] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:07.803329 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:07.813322 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a0a67-b60e-4cd5-bddd-361971b56f34 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:07.818159 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:07.818766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.819048 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.819321 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.819961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:07.821900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:07.849319 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1392/2816] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:07 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:07.853698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:07.864078 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc510b-5673-40e3-8abb-a1ce47850bae admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:07.923461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:07.924070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.924345 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.924618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.925298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:07.927217 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:07.951311 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1425/2817] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:07 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:31:07.955494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:07.966505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304693ff-9ca5-491d-9796-06e2cadc05e4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:07.973818 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:07.974998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:07.974998 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:07.975879 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:07.976540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:07.978184 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:07.998378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1393/2818] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:08.002609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.012874 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b16513-1707-46af-9cb1-b75bc6ecb1a6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.017607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77124d1b-c2d0-4d18-b282-73644f20b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.018207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124d1b-c2d0-4d18-b282-73644f20b636 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.018485 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124d1b-c2d0-4d18-b282-73644f20b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.018754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77124d1b-c2d0-4d18-b282-73644f20b636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.019388 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124d1b-c2d0-4d18-b282-73644f20b636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.020958 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77124d1b-c2d0-4d18-b282-73644f20b636 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.030887 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1426/2819] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:08.035037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.046605 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc0c3f-3b25-4ad8-abf9-44544ce8ff03 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.051309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.051907 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.052181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.052450 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] PATH_INFO: `/v3/projects/f4f487d34e90428381b258a12ad26d9d/users/b20864fd2f7c4f48a0b9a30659462dd7/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.068011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f487d34e90428381b258a12ad26d9d, user_id=b20864fd2f7c4f48a0b9a30659462dd7, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.070661 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.082697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1394/2820] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:08 2022] PUT /identity/v3/projects/f4f487d34e90428381b258a12ad26d9d/users/b20864fd2f7c4f48a0b9a30659462dd7/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:08.092872 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.093229 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.093508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.101574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:08.125084 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] MFA Rules not processed for user `b20864fd2f7c4f48a0b9a30659462dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:08.126332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:08.194389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1427/2821] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:08.199012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.261058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c807f4-bcee-440c-947e-d154ddfcac95 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.266432 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.267036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.267317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.267593 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.268232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.270178 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.298886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1395/2822] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:08 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:08.303157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.314687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d697d4f-dd03-4b04-af9b-e4bfff9c5c0c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.374292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.374908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.375190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.375466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.376101 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.378070 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.400568 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1428/2823] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:08 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:08.405127 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.415425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552237f1-bdc7-4c4e-98a0-53913a15a0ce admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.420171 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.420761 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.421035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.421355 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.421988 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.423778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.434521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1396/2824] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:08.439091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.451799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c514437-faeb-44e0-a0b3-4d8b8c1a541f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.457039 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.457738 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.458018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.458292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] PATH_INFO: `/v3/projects/68dd6afc522c4c2d90ba7d18039eaa6f/users/40a76d4aa90d444c947e0f12cf602fae/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.473889 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dd6afc522c4c2d90ba7d18039eaa6f, user_id=40a76d4aa90d444c947e0f12cf602fae, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.476603 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.492143 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1429/2825] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:08 2022] PUT /identity/v3/projects/68dd6afc522c4c2d90ba7d18039eaa6f/users/40a76d4aa90d444c947e0f12cf602fae/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:08.496544 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.511518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524373f-ea4c-476b-9407-b99097cf43ad admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.517021 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:08.572212 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617e1b0-d5bf-4404-8764-cc81e83361ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.572733 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617e1b0-d5bf-4404-8764-cc81e83361ab admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.573014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617e1b0-d5bf-4404-8764-cc81e83361ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.573324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617e1b0-d5bf-4404-8764-cc81e83361ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.573973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617e1b0-d5bf-4404-8764-cc81e83361ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.575648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617e1b0-d5bf-4404-8764-cc81e83361ab admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.585552 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1397/2826] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:08.589911 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.601087 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021dda6-d978-49cf-98f3-c5f3c3b0fb1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.606368 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.607282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.607574 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.607857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] PATH_INFO: `/v3/projects/68dd6afc522c4c2d90ba7d18039eaa6f/users/40a76d4aa90d444c947e0f12cf602fae/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.610634 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68dd6afc522c4c2d90ba7d18039eaa6f, user_id=40a76d4aa90d444c947e0f12cf602fae, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.613431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.626195 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1430/2827] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:08 2022] PUT /identity/v3/projects/68dd6afc522c4c2d90ba7d18039eaa6f/users/40a76d4aa90d444c947e0f12cf602fae/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:08.637900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.638203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.638493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.666804 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] MFA Rules not processed for user `40a76d4aa90d444c947e0f12cf602fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:08.668014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:08.743887 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1398/2828] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:08.755462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:08.757363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:08.813370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:08.819795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17844-bb48-4576-84ed-e93afbbb3836 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:08.825314 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24d89-5286-452e-b71a-64054c3c18e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:08.826267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24d89-5286-452e-b71a-64054c3c18e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:08.826570 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24d89-5286-452e-b71a-64054c3c18e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:08.826848 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24d89-5286-452e-b71a-64054c3c18e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:08.836490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24d89-5286-452e-b71a-64054c3c18e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:08.837969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24d89-5286-452e-b71a-64054c3c18e7 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:08.848578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1431/2829] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:31:09.414459 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:09.479268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d762fa-80f8-4342-9231-16705ad9c481 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:09.484692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:09.485354 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:09.485641 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:09.485918 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] PATH_INFO: `/v3/users/b20864fd2f7c4f48a0b9a30659462dd7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:09.487060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20864fd2f7c4f48a0b9a30659462dd7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:09.488995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:09.523756 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:09.537770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20864fd2f7c4f48a0b9a30659462dd7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:09.538433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20864fd2f7c4f48a0b9a30659462dd7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:09.546806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20864fd2f7c4f48a0b9a30659462dd7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:09.560019 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20864fd2f7c4f48a0b9a30659462dd7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:09.560696 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20864fd2f7c4f48a0b9a30659462dd7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:09.572731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1399/2830] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:09 2022] DELETE /identity/v3/users/b20864fd2f7c4f48a0b9a30659462dd7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:09.577389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:09.577674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:09.577951 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:09.597309 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:09.598572 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:09.660004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1432/2831] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:09.670992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:09.672416 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:09.736617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e8098-1fe1-4416-b83d-3f302b394c15 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:09.740421 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:09.741069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:09.741377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:09.741650 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:09.751838 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:09.753307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:09.763172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1400/2832] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:10.047952 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:10.049407 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:10.072706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce123d8e-bcea-49f4-aeb9-af0f4844d6c6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:10.079018 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:10.079940 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.080389 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.080675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] PATH_INFO: `/v3/projects/f4f487d34e90428381b258a12ad26d9d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.082044 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f487d34e90428381b258a12ad26d9d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:10.083991 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:10.134342 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f487d34e90428381b258a12ad26d9d', 'request_id': 'req-dcc3c153-2be9-480a-9c16-47683528809a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.141103 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f487d34e90428381b258a12ad26d9d', 'request_id': 'req-dcc3c153-2be9-480a-9c16-47683528809a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.149484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f487d34e90428381b258a12ad26d9d', 'request_id': 'req-dcc3c153-2be9-480a-9c16-47683528809a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.162056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] The token cache is being invalidate because project f4f487d34e90428381b258a12ad26d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:10.162347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.162988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.164472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1433/2833] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:10 2022] DELETE /identity/v3/projects/f4f487d34e90428381b258a12ad26d9d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:10.168794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:10.178172 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa50c-9061-4291-b20c-8babf8532e68 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:10.236996 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:10.237667 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.237945 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.238219 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] PATH_INFO: `/v3/users/40a76d4aa90d444c947e0f12cf602fae` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.239342 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a76d4aa90d444c947e0f12cf602fae)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:10.241372 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:10.287812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a76d4aa90d444c947e0f12cf602fae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.288447 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a76d4aa90d444c947e0f12cf602fae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.296726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a76d4aa90d444c947e0f12cf602fae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.297900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:10.312555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a76d4aa90d444c947e0f12cf602fae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.313339 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dfe2a7f5-bae0-4d8e-9b5d-debeebabf02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a76d4aa90d444c947e0f12cf602fae'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.325457 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1401/2834] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:10 2022] DELETE /identity/v3/users/40a76d4aa90d444c947e0f12cf602fae => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:10.627525 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:10.629024 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:10.646846 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3c153-2be9-480a-9c16-47683528809a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:10.708126 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:10.708847 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.709338 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.709721 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] PATH_INFO: `/v3/projects/68dd6afc522c4c2d90ba7d18039eaa6f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.711244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68dd6afc522c4c2d90ba7d18039eaa6f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:10.713224 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:10.729500 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:10.768822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68dd6afc522c4c2d90ba7d18039eaa6f', 'request_id': 'req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.776970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68dd6afc522c4c2d90ba7d18039eaa6f', 'request_id': 'req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.785200 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68dd6afc522c4c2d90ba7d18039eaa6f', 'request_id': 'req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.800204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] The token cache is being invalidate because project 68dd6afc522c4c2d90ba7d18039eaa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:10.800498 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.801208 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3ff2fb1b-af8e-48e5-ac39-f60e4be5d312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:10.802685 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1434/2835] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:10 2022] DELETE /identity/v3/projects/68dd6afc522c4c2d90ba7d18039eaa6f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:10.807914 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.808400 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.808621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.828289 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:10.829524 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:10.896462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1402/2836] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:10.904799 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.905137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.905638 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.927141 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:10.928337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:10.936567 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1435/2837] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:10.940734 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:10.951836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42011126-e169-4445-8eec-9f7f9f893cda None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:10.956584 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:10.957227 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.957510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.957784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.958425 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:10.958727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:10.960367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:10.973086 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1403/2838] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:10.977562 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:10.987290 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601b8e1-5778-4998-997e-93b6dc1d8c84 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:10.991921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:10.992522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:10.992794 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:10.993069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:10.993795 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:10.995648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.027138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1436/2839] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:11.031393 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.042151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72eba-f8b3-4e24-b22b-db28c9a096f4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.098726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.099334 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.099616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.099893 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.100521 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.102581 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.129455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1404/2840] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:11 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:11.133615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.148083 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980fbde-6e95-4306-8f03-4e0af0c2a88d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.153813 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.154432 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.154713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.155043 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.155635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.157249 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.169146 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1437/2841] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:11.173522 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.184244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff1e0-dc21-4e65-a390-511dfb7ea818 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.189046 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dc4a5-293a-4454-9475-8bcbd20b6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.189688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc4a5-293a-4454-9475-8bcbd20b6718 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.189965 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc4a5-293a-4454-9475-8bcbd20b6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.190235 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc4a5-293a-4454-9475-8bcbd20b6718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.190875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc4a5-293a-4454-9475-8bcbd20b6718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.192448 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dc4a5-293a-4454-9475-8bcbd20b6718 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.205069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1405/2842] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:11.209350 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.223114 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2445a7-9979-42e8-ba58-52c5d467bc14 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.227961 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.228829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.229312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.229623 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] PATH_INFO: `/v3/projects/f33f8d353df84ba0b85a27e816f44e76/users/77cf2cc99fbe4c07ab427e831a03e47b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.247298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33f8d353df84ba0b85a27e816f44e76, user_id=77cf2cc99fbe4c07ab427e831a03e47b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.250056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.268879 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1438/2843] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:11 2022] PUT /identity/v3/projects/f33f8d353df84ba0b85a27e816f44e76/users/77cf2cc99fbe4c07ab427e831a03e47b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:11.281129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.281510 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.281787 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.311058 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] MFA Rules not processed for user `77cf2cc99fbe4c07ab427e831a03e47b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:11.312308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:11.339169 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:11.382356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1406/2844] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:11.394286 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.396328 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:11.455251 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7719-af12-4549-8b0c-d1ea324d548b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.459073 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a8444-40a3-4051-9fab-1e2dadd03459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.459687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a8444-40a3-4051-9fab-1e2dadd03459 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.459983 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a8444-40a3-4051-9fab-1e2dadd03459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.460258 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a8444-40a3-4051-9fab-1e2dadd03459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.469878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a8444-40a3-4051-9fab-1e2dadd03459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.471361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a8444-40a3-4051-9fab-1e2dadd03459 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.480260 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1439/2845] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:11.502279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.569433 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b5d8-a1b4-4215-bb04-d79764b5bf2d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.574045 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.575217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.575609 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.575891 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] PATH_INFO: `/v3/users/77cf2cc99fbe4c07ab427e831a03e47b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.577030 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cf2cc99fbe4c07ab427e831a03e47b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.578973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.642561 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cf2cc99fbe4c07ab427e831a03e47b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:11.644434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cf2cc99fbe4c07ab427e831a03e47b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:11.657941 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cf2cc99fbe4c07ab427e831a03e47b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:11.672205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cf2cc99fbe4c07ab427e831a03e47b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:11.672953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cf2cc99fbe4c07ab427e831a03e47b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:11.685835 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1407/2846] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:11 2022] DELETE /identity/v3/users/77cf2cc99fbe4c07ab427e831a03e47b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:11.690275 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.690566 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.690844 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.711233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:11.712375 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:11.754478 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:11.777163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1440/2847] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:11.787301 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:11.788715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:11.845799 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:11.852105 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fe90a-bc09-433e-8d47-eff9a790b283 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:11.856927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5da4f-9390-4f79-b337-4e0b7b400e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:11.857576 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5da4f-9390-4f79-b337-4e0b7b400e52 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:11.857878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5da4f-9390-4f79-b337-4e0b7b400e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:11.858150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5da4f-9390-4f79-b337-4e0b7b400e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:11.870365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5da4f-9390-4f79-b337-4e0b7b400e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:11.871863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5da4f-9390-4f79-b337-4e0b7b400e52 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:11.881878 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1408/2848] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:12.163284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.164704 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:12.179617 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7fa0d-ed54-4f3e-b373-275c16efca27 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.188609 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.189355 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.189662 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.189896 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] PATH_INFO: `/v3/projects/f33f8d353df84ba0b85a27e816f44e76` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.191091 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33f8d353df84ba0b85a27e816f44e76)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.193218 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.246470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33f8d353df84ba0b85a27e816f44e76', 'request_id': 'req-9cb02e73-2c07-4b55-adcd-6ee0d884642f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:12.251864 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33f8d353df84ba0b85a27e816f44e76', 'request_id': 'req-9cb02e73-2c07-4b55-adcd-6ee0d884642f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:12.264919 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33f8d353df84ba0b85a27e816f44e76', 'request_id': 'req-9cb02e73-2c07-4b55-adcd-6ee0d884642f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:12.276379 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] The token cache is being invalidate because project f33f8d353df84ba0b85a27e816f44e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:12.276672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:12.277947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9cb02e73-2c07-4b55-adcd-6ee0d884642f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:12.279446 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1441/2849] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:12 2022] DELETE /identity/v3/projects/f33f8d353df84ba0b85a27e816f44e76 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:12.284276 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.284542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.284836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.305281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:12.306503 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:12.368774 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1409/2850] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:12.376577 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.376865 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.377170 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.399973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:12.401219 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:12.410117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1442/2851] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:12.414743 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.425015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3106cc2-3d6e-4246-ade2-2568bc90dfe3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.429703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.430305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.430586 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.430885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.431534 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:12.431834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.433475 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.445905 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1410/2852] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:31:12.450873 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.460257 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418e10a-f57a-4a19-adec-26c6df362ee4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.465405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.466047 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.466374 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.466651 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.467282 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.469209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.498596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1443/2853] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:12 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:12.502599 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.513536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a151eee-e04b-4574-a312-89cc6f086b83 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.571591 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.572194 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.572469 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.572738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.573408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.575997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.598356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1411/2854] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:12 2022] POST /identity/v3/users => generated 281 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:12.602479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.615730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd721c4d-2990-45db-88ab-9cccc340bac1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.620503 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.621137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.621421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.621694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.622343 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.623947 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.634326 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1444/2855] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:12.639166 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.649439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c30cf9-23f5-44ea-86e5-70fd6a63c60c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.655367 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72020488-dcac-4c08-b123-9404c1ef88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.656012 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020488-dcac-4c08-b123-9404c1ef88b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.656299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020488-dcac-4c08-b123-9404c1ef88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.656577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72020488-dcac-4c08-b123-9404c1ef88b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.657343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72020488-dcac-4c08-b123-9404c1ef88b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.658973 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72020488-dcac-4c08-b123-9404c1ef88b1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.670382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1412/2856] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:12.674730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.685578 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d51f8-96a1-49fd-805c-dd54979e17a8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.690160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.690828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.691093 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.691371 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] PATH_INFO: `/v3/projects/ed7ec916f193413985fb700bde667205/users/eee40a50c44940ee8ad02e5bd048fdad/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.712069 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7ec916f193413985fb700bde667205, user_id=eee40a50c44940ee8ad02e5bd048fdad, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.715204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.731850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1445/2857] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:12 2022] PUT /identity/v3/projects/ed7ec916f193413985fb700bde667205/users/eee40a50c44940ee8ad02e5bd048fdad/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:12.745370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.745653 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.745931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.781675 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] MFA Rules not processed for user `eee40a50c44940ee8ad02e5bd048fdad`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:12.783770 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:12.835014 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:12.856732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1413/2858] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:12.892853 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:12.894575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:12.951705 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e35c39-3007-4454-a0ce-6c0d30fe6ea1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:12.955307 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1ce4d-d194-49cf-b3d5-f6ee09d89bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:12.955938 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1ce4d-d194-49cf-b3d5-f6ee09d89bbc service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:12.956213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1ce4d-d194-49cf-b3d5-f6ee09d89bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:12.956484 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1ce4d-d194-49cf-b3d5-f6ee09d89bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:12.965618 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1ce4d-d194-49cf-b3d5-f6ee09d89bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:12.967317 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1ce4d-d194-49cf-b3d5-f6ee09d89bbc service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:12.976675 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1446/2859] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:12.992129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:13.058254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2ad8-8fda-4dd5-9e66-8a995109d70f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:13.063300 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:13.063931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.064209 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.064481 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] PATH_INFO: `/v3/users/eee40a50c44940ee8ad02e5bd048fdad` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.065619 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee40a50c44940ee8ad02e5bd048fdad)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:13.067523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:13.115061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee40a50c44940ee8ad02e5bd048fdad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.115712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee40a50c44940ee8ad02e5bd048fdad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.124188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee40a50c44940ee8ad02e5bd048fdad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.137260 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee40a50c44940ee8ad02e5bd048fdad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.138215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee40a50c44940ee8ad02e5bd048fdad'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.151028 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1414/2860] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:12 2022] DELETE /identity/v3/users/eee40a50c44940ee8ad02e5bd048fdad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:13.156151 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.156461 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.156747 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.166448 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:13.179370 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:13.181385 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:13.246362 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1447/2861] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:13.255940 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:13.257387 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:13.325589 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdebd9c-5a02-4078-9317-293adba718a4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:13.329410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7aa38-b04c-418c-96e3-e12d6055a9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:13.330122 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7aa38-b04c-418c-96e3-e12d6055a9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.330542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7aa38-b04c-418c-96e3-e12d6055a9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.330816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7aa38-b04c-418c-96e3-e12d6055a9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.341196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7aa38-b04c-418c-96e3-e12d6055a9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:13.342713 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7aa38-b04c-418c-96e3-e12d6055a9f8 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:13.353412 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1415/2862] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:13.644606 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:13.647002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:13.674636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da446d7-4f22-456a-b8b6-57fc82435627 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:13.674636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:13.674636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.674636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.675501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] PATH_INFO: `/v3/projects/ed7ec916f193413985fb700bde667205` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.675501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7ec916f193413985fb700bde667205)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:13.675501 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:13.724714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7ec916f193413985fb700bde667205', 'request_id': 'req-a0dd6b2e-9b20-4571-a235-65b7e53b0525'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.730725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7ec916f193413985fb700bde667205', 'request_id': 'req-a0dd6b2e-9b20-4571-a235-65b7e53b0525'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.738481 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7ec916f193413985fb700bde667205', 'request_id': 'req-a0dd6b2e-9b20-4571-a235-65b7e53b0525'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.750431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] The token cache is being invalidate because project ed7ec916f193413985fb700bde667205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:13.750730 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.751470 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a0dd6b2e-9b20-4571-a235-65b7e53b0525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:13.753304 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1448/2863] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:13 2022] DELETE /identity/v3/projects/ed7ec916f193413985fb700bde667205 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:13.758990 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.759282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.759566 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.774414 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:13.783377 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:13.785173 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:13.848128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1416/2864] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:13.859441 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.859741 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.860021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.879994 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:13.881239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:13.889240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1449/2865] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:13.893452 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:13.903038 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12d05c-08f3-4dd7-bad3-1e0c5c1e9a92 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:13.907559 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:13.908151 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.908430 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.908703 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.909381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:13.909684 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:13.911269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:13.923601 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1417/2866] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:13.927903 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:13.937829 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d1e26-c03d-4438-a1c2-ad260ed6ceb0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:13.942509 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:13.943108 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:13.943387 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:13.943660 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:13.944302 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:13.946324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:13.974466 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1450/2867] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:13 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:13.978784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:13.988836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3719e-9f64-4d70-a6c4-c7ffebf4df2d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:14.050009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:14.050739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.050994 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.051272 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.051900 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:14.053975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:14.076726 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1418/2868] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:13 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:14.080930 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:14.092038 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50b53-381a-4fb6-a7cc-5235e73eedf8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:14.098209 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:14.098925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.099265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.099607 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.100252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:14.101922 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:14.112529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1451/2869] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:14.117370 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:14.127819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7d9aa-d1fe-4a51-a593-b9f9b94db041 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:14.132636 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02a7cb-ba9f-4183-89fa-05975ba23b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:14.133286 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02a7cb-ba9f-4183-89fa-05975ba23b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.133569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02a7cb-ba9f-4183-89fa-05975ba23b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.133846 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02a7cb-ba9f-4183-89fa-05975ba23b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.134493 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02a7cb-ba9f-4183-89fa-05975ba23b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:14.136093 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02a7cb-ba9f-4183-89fa-05975ba23b7b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:14.148466 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1419/2870] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:14.153559 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:14.163431 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d5fab-0064-486f-9a29-ab8e89c35a94 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:14.168833 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:14.169520 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.169802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.170081 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] PATH_INFO: `/v3/projects/3597dfbe682c4278965d9527c1adf38a/users/5d6cdb049bb74d679c6d82adcc1a3407/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.185082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3597dfbe682c4278965d9527c1adf38a, user_id=5d6cdb049bb74d679c6d82adcc1a3407, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:14.187753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:14.205687 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1452/2871] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:14 2022] PUT /identity/v3/projects/3597dfbe682c4278965d9527c1adf38a/users/5d6cdb049bb74d679c6d82adcc1a3407/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:14.215999 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.216280 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.216555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.244121 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] MFA Rules not processed for user `5d6cdb049bb74d679c6d82adcc1a3407`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:14.245388 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:14.309972 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1420/2872] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:14.321092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:14.322790 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:14.351153 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:14.383027 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446740b-d411-4337-97ef-20684c2b1611 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:14.387179 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0dca5-d286-45f1-b9be-8e89ca450de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:14.387753 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0dca5-d286-45f1-b9be-8e89ca450de2 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.388028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0dca5-d286-45f1-b9be-8e89ca450de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.388292 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0dca5-d286-45f1-b9be-8e89ca450de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.396289 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0dca5-d286-45f1-b9be-8e89ca450de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:14.398154 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0dca5-d286-45f1-b9be-8e89ca450de2 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:14.407144 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1453/2873] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:14.703606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:14.705331 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:14.710456 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:14.787616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8910787-7adf-4bb0-97f4-4ae874ae4432 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:14.787616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:14.787616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.787616 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.787997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] PATH_INFO: `/v3/users/5d2e382efa3c428fb3b452399c63fd0b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.787997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2e382efa3c428fb3b452399c63fd0b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:14.787997 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:14.853621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2e382efa3c428fb3b452399c63fd0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:14.854539 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2e382efa3c428fb3b452399c63fd0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:14.877526 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2e382efa3c428fb3b452399c63fd0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:14.892383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2e382efa3c428fb3b452399c63fd0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:14.893152 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2e382efa3c428fb3b452399c63fd0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:14.906309 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1421/2874] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:14 2022] DELETE /identity/v3/users/5d2e382efa3c428fb3b452399c63fd0b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:14.910676 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:14.910974 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:14.911244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:14.930866 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:14.932059 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:14.990557 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1454/2875] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:15.001963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.003362 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:15.061429 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46648dd3-9c76-4435-b8fe-67f37cefe58c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.065009 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08027d-5321-45f7-b20a-74fd3717319d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.065635 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08027d-5321-45f7-b20a-74fd3717319d service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.065915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08027d-5321-45f7-b20a-74fd3717319d service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.066189 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08027d-5321-45f7-b20a-74fd3717319d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.075518 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08027d-5321-45f7-b20a-74fd3717319d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.076880 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08027d-5321-45f7-b20a-74fd3717319d service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.086188 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1422/2876] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:15.356778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.358529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:15.371635 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9f3f1-e0f1-480c-9a5b-27edc5ae8113 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.376278 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.376915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.377238 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.377515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] PATH_INFO: `/v3/projects/d6b2fb2a297a40fea543e397acb783d6` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.378639 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b2fb2a297a40fea543e397acb783d6)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.380758 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.429856 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b2fb2a297a40fea543e397acb783d6', 'request_id': 'req-ce52309b-7828-46bb-9178-685c040bb86c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:15.437641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b2fb2a297a40fea543e397acb783d6', 'request_id': 'req-ce52309b-7828-46bb-9178-685c040bb86c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:15.445056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b2fb2a297a40fea543e397acb783d6', 'request_id': 'req-ce52309b-7828-46bb-9178-685c040bb86c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:15.456900 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] The token cache is being invalidate because project d6b2fb2a297a40fea543e397acb783d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:15.457228 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:15.457909 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ce52309b-7828-46bb-9178-685c040bb86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:15.459429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1455/2877] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:15 2022] DELETE /identity/v3/projects/d6b2fb2a297a40fea543e397acb783d6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:15.465828 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.466124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.466397 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.486203 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:15.487410 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:15.506324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:15.550096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1423/2878] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:15.558118 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.558479 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.558759 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.578819 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:15.580028 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:15.587970 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1456/2879] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:15.592767 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.602520 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7021-1cd5-4ff2-a4a2-9ea73da819df None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.607898 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.608505 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.608786 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.609089 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.609771 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:15.610076 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.611663 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.624498 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1424/2880] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:15.629071 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.638616 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ece9-6864-4054-9ab3-7e35ffac1ce8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.643400 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.643996 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.644269 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.644535 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.645204 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.647109 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.675469 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1457/2881] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:15 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:15.679740 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.689567 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4125-eaa9-42a0-a946-acd47be4dccd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.744464 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.745069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.745382 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.745658 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.746352 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.748420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.774077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1425/2882] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:15 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:15.778962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.789381 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f4a97-f654-4c77-a455-a555a8325d8a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.794796 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.795391 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.795671 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.795949 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.796593 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.798305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.808147 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1458/2883] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:15.813269 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.823150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa126d-eec3-4d82-987c-97f195fd5628 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.828375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576ec93-abc5-42a0-a36e-09f38f476c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.828958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576ec93-abc5-42a0-a36e-09f38f476c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.829281 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576ec93-abc5-42a0-a36e-09f38f476c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.829551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576ec93-abc5-42a0-a36e-09f38f476c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.830181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576ec93-abc5-42a0-a36e-09f38f476c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.831752 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576ec93-abc5-42a0-a36e-09f38f476c1e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.843467 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1426/2884] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:15.847762 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:15.858384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f77f4-e399-4de1-b532-9f31241909d4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:15.867102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:15.868728 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.869522 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.869884 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] PATH_INFO: `/v3/projects/8822d4549a7c40d790eebeef45d4a246/users/c02e09ee2f0849d2bab368a73d6f0b45/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.879740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:15.888014 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8822d4549a7c40d790eebeef45d4a246, user_id=c02e09ee2f0849d2bab368a73d6f0b45, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:15.891973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:15.916416 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1459/2885] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:15 2022] PUT /identity/v3/projects/8822d4549a7c40d790eebeef45d4a246/users/c02e09ee2f0849d2bab368a73d6f0b45/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:15.922237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:15.923039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:15.923315 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:15.954958 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:15.956249 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:16.021160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1427/2886] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:16.031456 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:16.033316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:16.112142 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fd53d-3b1c-4179-8595-0c3b2ad02641 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:16.116092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cb3ec-6220-4816-9079-b8ce44446ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:16.116706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb3ec-6220-4816-9079-b8ce44446ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:16.116988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb3ec-6220-4816-9079-b8ce44446ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:16.117295 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb3ec-6220-4816-9079-b8ce44446ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:16.127021 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cb3ec-6220-4816-9079-b8ce44446ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:16.128472 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2cb3ec-6220-4816-9079-b8ce44446ee2 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:16.138802 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1460/2887] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:19.596015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:19.598035 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:19.616095 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79415edd-94b4-477e-bad6-1a619bfe19c3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:19.631148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:19.631766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:19.632854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:19.632854 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] PATH_INFO: `/v3/users/5d6cdb049bb74d679c6d82adcc1a3407` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:19.633739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6cdb049bb74d679c6d82adcc1a3407)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:19.643369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:19.698375 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:19.729130 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6cdb049bb74d679c6d82adcc1a3407'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:19.730284 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6cdb049bb74d679c6d82adcc1a3407'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:19.750160 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6cdb049bb74d679c6d82adcc1a3407'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:19.777688 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6cdb049bb74d679c6d82adcc1a3407'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:19.779606 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6cdb049bb74d679c6d82adcc1a3407'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:19.822068 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1428/2888] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:19 2022] DELETE /identity/v3/users/5d6cdb049bb74d679c6d82adcc1a3407 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:19.825373 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a53b3-6703-4a2c-a03e-f01bfd668c2e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:19.825840 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a53b3-6703-4a2c-a03e-f01bfd668c2e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:19.825962 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a53b3-6703-4a2c-a03e-f01bfd668c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:19.863098 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e21a53b3-6703-4a2c-a03e-f01bfd668c2e None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:19.868973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e21a53b3-6703-4a2c-a03e-f01bfd668c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:19.974165 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1461/2889] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:19.985324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:19.987091 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:20.121299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319959b-a077-46e8-87af-f4c218cb658d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:20.125487 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:20.126268 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:20.126555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:20.126829 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:20.142816 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:20.144434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:20.184192 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1429/2890] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:20.560169 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477cfae-d463-4427-9769-8be51266c403 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:20.560460 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477cfae-d463-4427-9769-8be51266c403 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:20.560731 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477cfae-d463-4427-9769-8be51266c403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:20.596088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4477cfae-d463-4427-9769-8be51266c403 None None] MFA Rules not processed for user `c02e09ee2f0849d2bab368a73d6f0b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:20.597703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4477cfae-d463-4427-9769-8be51266c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:20.612097 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:20.614497 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:20.640885 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b823-a19e-4c45-ad91-2027cdeee863 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:20.647246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:20.648408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:20.648931 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:20.649541 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] PATH_INFO: `/v3/projects/3597dfbe682c4278965d9527c1adf38a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:20.651195 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3597dfbe682c4278965d9527c1adf38a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:20.656341 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:20.706352 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1462/2891] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:20.710614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477cfae-d463-4427-9769-8be51266c403 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:20.712117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4477cfae-d463-4427-9769-8be51266c403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:20.725844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3597dfbe682c4278965d9527c1adf38a', 'request_id': 'req-4d34bce0-d76c-4481-b538-cd338981af3f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:20.727337 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477cfae-d463-4427-9769-8be51266c403 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:20.736037 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3597dfbe682c4278965d9527c1adf38a', 'request_id': 'req-4d34bce0-d76c-4481-b538-cd338981af3f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:20.744621 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3597dfbe682c4278965d9527c1adf38a', 'request_id': 'req-4d34bce0-d76c-4481-b538-cd338981af3f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:20.757185 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:20.758668 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] The token cache is being invalidate because project 3597dfbe682c4278965d9527c1adf38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:20.759225 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:20.760124 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:20.763222 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1430/2892] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:20 2022] DELETE /identity/v3/projects/3597dfbe682c4278965d9527c1adf38a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:31:20.822445 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:20.823082 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:20.823363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:20.823636 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:20.825004 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:20.827113 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:20.861205 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1463/2893] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:20 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:31:20.866215 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:20.868305 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:20.883299 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34bce0-d76c-4481-b538-cd338981af3f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:20.916833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:20.958314 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:20.959446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:20.960246 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:20.960738 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:20.961646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:20.963866 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:20.993174 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1431/2894] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:20 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:20.996447 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:21.008382 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093235ca-9675-4d09-9114-77879680c740 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:21.014693 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:21.015332 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:21.015613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:21.015898 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:21.016694 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:21.018383 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:21.033283 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1464/2895] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:21.034461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:21.045297 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f6f1a-fa1e-4800-a63b-7546c218940e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:21.050128 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:21.050794 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:21.051069 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:21.051340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] PATH_INFO: `/v3/projects/72e2ffb7edf248c48da21d6c71f953be/users/53ed844f34e04629af7e46003f40273a/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:21.068356 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e2ffb7edf248c48da21d6c71f953be, user_id=53ed844f34e04629af7e46003f40273a, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:21.071096 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:21.087538 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1432/2896] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:21 2022] PUT /identity/v3/projects/72e2ffb7edf248c48da21d6c71f953be/users/53ed844f34e04629af7e46003f40273a/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:21.091367 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:21.102068 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893fb5d-fbd3-464c-97fa-40f6209750fd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:21.161915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848822e-ecba-46c3-acde-cea727215694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:21.162538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848822e-ecba-46c3-acde-cea727215694 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:21.162820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848822e-ecba-46c3-acde-cea727215694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:21.163100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848822e-ecba-46c3-acde-cea727215694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:21.163744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848822e-ecba-46c3-acde-cea727215694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:21.165641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848822e-ecba-46c3-acde-cea727215694 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:21.177823 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1465/2897] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:21.181715 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:21.192976 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75738ca-054c-4861-93db-b3045928ae93 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:21.197989 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:21.198565 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:21.198870 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:21.199822 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] PATH_INFO: `/v3/projects/72e2ffb7edf248c48da21d6c71f953be/users/53ed844f34e04629af7e46003f40273a/roles/eb15617c2b2f4990900925ac0a1e8bfc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:21.203420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e2ffb7edf248c48da21d6c71f953be, user_id=53ed844f34e04629af7e46003f40273a, role_id=eb15617c2b2f4990900925ac0a1e8bfc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:21.206302 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:21.218678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1433/2898] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:21 2022] PUT /identity/v3/projects/72e2ffb7edf248c48da21d6c71f953be/users/53ed844f34e04629af7e46003f40273a/roles/eb15617c2b2f4990900925ac0a1e8bfc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:25.965158 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d00ffd-131a-4996-8715-5cad8365eabe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:25.966171 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d00ffd-131a-4996-8715-5cad8365eabe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:25.966462 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d00ffd-131a-4996-8715-5cad8365eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:25.997923 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-27d00ffd-131a-4996-8715-5cad8365eabe None None] MFA Rules not processed for user `53ed844f34e04629af7e46003f40273a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:25.999276 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-27d00ffd-131a-4996-8715-5cad8365eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:26.082490 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1466/2899] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:26.095814 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:26.097573 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:26.171232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e892-31f7-46e0-817b-bb88e0b9a12d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:26.178217 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '016885b1849e4e3d990c3de23c479399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:26.178884 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:26.179164 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:26.179446 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:26.181461 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:26.254175 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:26.255678 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:26.266851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1434/2900] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:26.423924 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:26.424600 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:26.426523 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:26.459883 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:26.466703 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:26.468196 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:26.552691 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1467/2901] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:31:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:26.610240 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:26.612208 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:26.654739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:26.688782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc6fbb-ddd6-4f37-abb2-8fdb40218fde service glance] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:26.694082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8de44-0f16-407e-a8bf-7b4d41fa95e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:26.695056 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8de44-0f16-407e-a8bf-7b4d41fa95e6 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:26.695455 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8de44-0f16-407e-a8bf-7b4d41fa95e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:26.695732 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8de44-0f16-407e-a8bf-7b4d41fa95e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:26.705244 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8de44-0f16-407e-a8bf-7b4d41fa95e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:26.706953 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8de44-0f16-407e-a8bf-7b4d41fa95e6 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:26.715586 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1435/2902] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:31:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:31:27.506507 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:27.508280 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:27.610233 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba79e8-fb32-47e0-bdf2-da973147c6b4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:27.615463 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:27.616216 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:27.616569 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:27.616955 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] PATH_INFO: `/v3/users/c83c14b5bb1c41d9b7cc27b6947b1550` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:27.624181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83c14b5bb1c41d9b7cc27b6947b1550)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:27.624181 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:27.692333 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83c14b5bb1c41d9b7cc27b6947b1550'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:27.693364 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83c14b5bb1c41d9b7cc27b6947b1550'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:27.701771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83c14b5bb1c41d9b7cc27b6947b1550'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:27.713682 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83c14b5bb1c41d9b7cc27b6947b1550'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:27.715046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83c14b5bb1c41d9b7cc27b6947b1550'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:27.743780 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1468/2903] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:27 2022] DELETE /identity/v3/users/c83c14b5bb1c41d9b7cc27b6947b1550 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:27.748910 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:27.749494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:27.749494 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:27.777963 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:27.779762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:27.882912 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1436/2904] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:27.893267 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:27.895050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:27.937324 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:27.999854 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46260a9a-0f38-44b0-8e08-4783d17c160b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:28.003784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755cc7c-d4bd-4bc5-8c6a-1630b294feef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:28.004408 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cc7c-d4bd-4bc5-8c6a-1630b294feef service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.004690 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cc7c-d4bd-4bc5-8c6a-1630b294feef service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.005155 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cc7c-d4bd-4bc5-8c6a-1630b294feef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.017412 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755cc7c-d4bd-4bc5-8c6a-1630b294feef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:28.018907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755cc7c-d4bd-4bc5-8c6a-1630b294feef service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:28.031250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1469/2905] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:28.471985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:28.473438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:28.496875 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d970a-698c-4be8-b608-a24fb57c85e7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:28.502232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:28.503313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.503681 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.503975 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] PATH_INFO: `/v3/projects/ecc7e7495237497b981d82274819c2bf` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.505253 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc7e7495237497b981d82274819c2bf)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:28.509365 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:28.623512 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc7e7495237497b981d82274819c2bf', 'request_id': 'req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:28.641753 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc7e7495237497b981d82274819c2bf', 'request_id': 'req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:28.649337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc7e7495237497b981d82274819c2bf', 'request_id': 'req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:28.664351 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] The token cache is being invalidate because project ecc7e7495237497b981d82274819c2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:28.664754 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:28.665906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-152dde00-4ec4-43af-ab8a-ca1e11ecdadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:28.672685 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1437/2906] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:28 2022] DELETE /identity/v3/projects/ecc7e7495237497b981d82274819c2bf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:28.675124 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.676674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.676674 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.717779 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:28.719361 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:28.821163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1470/2907] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:28.827431 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.828001 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.828263 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.853323 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:28.854749 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:28.868773 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:28.877073 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1438/2908] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:28.887641 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d91f94-5f19-4463-aa18-a66aa255d1d2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:28.895594 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:28.896477 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.896925 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.897421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.898244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:28.898717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:28.904075 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:28.921239 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1471/2909] 10.222.0.88 () {58 vars in 1153 bytes} [Mon Aug 29 23:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:28.925050 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:28.945257 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952a2d-f2aa-4d49-92da-4116b1165b29 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:28.955547 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:28.956825 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.958692 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.959077 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.961646 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:28.969548 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:29.021569 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1439/2910] 10.222.0.88 () {60 vars in 1153 bytes} [Mon Aug 29 23:31:28 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:29.024296 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:29.037363 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9164f3-77cc-4f94-8eec-6e3b3c647212 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:29.135906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:29.136756 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:29.137034 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:29.139121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:29.139755 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:29.141767 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:29.176979 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1472/2911] 10.222.0.88 () {60 vars in 1144 bytes} [Mon Aug 29 23:31:29 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:31:29.178369 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:29.196739 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94f364-386a-4af0-a429-85a3a84d623e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:29.201904 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:29.202535 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:29.202812 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:29.203082 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:29.204022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:29.205784 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:29.223792 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1440/2912] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:29.224986 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:29.240095 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03cb4c-e5d0-40ce-9ddc-b1eecbda3e5f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:29.246163 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b5f7-832c-44ca-9f8d-d6631ef4c42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:29.246976 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b5f7-832c-44ca-9f8d-d6631ef4c42b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:29.247305 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b5f7-832c-44ca-9f8d-d6631ef4c42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:29.247579 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b5f7-832c-44ca-9f8d-d6631ef4c42b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:29.248521 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b5f7-832c-44ca-9f8d-d6631ef4c42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:29.252002 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b5f7-832c-44ca-9f8d-d6631ef4c42b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:29.273202 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1473/2913] 10.222.0.88 () {58 vars in 1122 bytes} [Mon Aug 29 23:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:31:29.277274 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:29.290039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf6f0b-4e69-4c71-982f-95bde306b8a6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:29.306378 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:29.307345 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:29.307707 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:29.308343 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] PATH_INFO: `/v3/projects/8fa7dd7898bd455bbfead7a778408d3c/users/bd76568a90b148d3af86da306694a32b/roles/d3a9964e8377460cb21bb016acd86e6c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:29.315337 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:29.334542 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa7dd7898bd455bbfead7a778408d3c, user_id=bd76568a90b148d3af86da306694a32b, role_id=d3a9964e8377460cb21bb016acd86e6c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:29.339995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:29.361731 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1441/2914] 10.222.0.88 () {60 vars in 1483 bytes} [Mon Aug 29 23:31:29 2022] PUT /identity/v3/projects/8fa7dd7898bd455bbfead7a778408d3c/users/bd76568a90b148d3af86da306694a32b/roles/d3a9964e8377460cb21bb016acd86e6c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:29.374993 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9265-3e1f-4edb-bd8c-0a429de04141 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:29.375587 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9265-3e1f-4edb-bd8c-0a429de04141 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:29.376096 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9265-3e1f-4edb-bd8c-0a429de04141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:29.418820 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c49d9265-3e1f-4edb-bd8c-0a429de04141 None None] MFA Rules not processed for user `bd76568a90b148d3af86da306694a32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:29.420054 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c49d9265-3e1f-4edb-bd8c-0a429de04141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:29.451150 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:29.517063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1474/2915] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:29.534311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:29.536758 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:29.629205 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52a9f9-0bb7-485b-ba66-4a1e96ac86fe admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:29.634441 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930e702-ef39-4b89-8947-42385a72dabe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cda9da215144c6ca429f8787be283f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:29.637162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930e702-ef39-4b89-8947-42385a72dabe service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:29.637162 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930e702-ef39-4b89-8947-42385a72dabe service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:29.637798 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930e702-ef39-4b89-8947-42385a72dabe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:29.649995 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930e702-ef39-4b89-8947-42385a72dabe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:29.653282 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930e702-ef39-4b89-8947-42385a72dabe service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:29.683308 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1442/2916] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:31:35.763347 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:35.763827 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:35.764053 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:35.783100 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] MFA Rules not processed for user `c02e09ee2f0849d2bab368a73d6f0b45`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:35.784312 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:35.839137 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1475/2917] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:31:38.216679 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:38.217834 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:38.218311 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:38.240935 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:38.242408 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:38.317288 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1443/2918] 10.222.0.88 () {58 vars in 1009 bytes} [Mon Aug 29 23:31:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:38.328424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:38.330046 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:38.423121 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f3daf-7fbf-428b-803d-c9f75a25493a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:38.430227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5aee6a-c2b5-4af3-8501-03a0cd6a35c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:38.431221 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aee6a-c2b5-4af3-8501-03a0cd6a35c7 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:38.431565 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aee6a-c2b5-4af3-8501-03a0cd6a35c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:38.431915 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5aee6a-c2b5-4af3-8501-03a0cd6a35c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:38.444744 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5aee6a-c2b5-4af3-8501-03a0cd6a35c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:38.446452 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5aee6a-c2b5-4af3-8501-03a0cd6a35c7 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:38.456644 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1476/2919] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:31:40.394859 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:40.468085 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a040d-517f-4d00-bec4-829ae91228b3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.472764 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.473642 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.474099 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.474536 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] PATH_INFO: `/v3/users/bd76568a90b148d3af86da306694a32b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.475851 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd76568a90b148d3af86da306694a32b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:40.478148 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:40.524922 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.537886 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd76568a90b148d3af86da306694a32b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:40.538746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd76568a90b148d3af86da306694a32b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:40.548070 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd76568a90b148d3af86da306694a32b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:40.561324 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd76568a90b148d3af86da306694a32b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:40.562119 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd76568a90b148d3af86da306694a32b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:40.575027 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1444/2920] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:31:40 2022] DELETE /identity/v3/users/bd76568a90b148d3af86da306694a32b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:40.579310 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.579811 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.580012 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.602982 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] MFA Rules not processed for user `4ab308fcca9747a8a7a9f433ecd95299`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:40.604318 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:40.662430 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.676912 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1477/2921] 10.222.0.88 () {58 vars in 958 bytes} [Mon Aug 29 23:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:31:40.688540 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:40.690059 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:40.761710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371a952-7de6-48e7-b99a-103ed7c5c223 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.766938 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.767772 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.768129 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.768682 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.779648 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:40.781146 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:40.793712 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1445/2922] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:31:41.099878 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:41.101436 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:41.140203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d0697-962d-4dc4-a85c-50b73a836819 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:41.155717 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:41.156754 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:41.158225 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:41.158714 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] PATH_INFO: `/v3/projects/8fa7dd7898bd455bbfead7a778408d3c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:41.160803 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa7dd7898bd455bbfead7a778408d3c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:41.164248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:41.249815 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa7dd7898bd455bbfead7a778408d3c', 'request_id': 'req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:41.258778 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa7dd7898bd455bbfead7a778408d3c', 'request_id': 'req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:41.268969 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa7dd7898bd455bbfead7a778408d3c', 'request_id': 'req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:41.284629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] The token cache is being invalidate because project 8fa7dd7898bd455bbfead7a778408d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:31:41.284956 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:41.285648 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:31:41.287384 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1478/2923] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:31:41 2022] DELETE /identity/v3/projects/8fa7dd7898bd455bbfead7a778408d3c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:31:50.788147 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:51.281065 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:57.993434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:57.994833 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:58.006307 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0b04-558a-4557-8704-cf9c7b1cdb9c service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:58.056181 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:58.056779 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:58.057053 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:58.057420 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:58.059470 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:58.120015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:58.121827 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:58.131395 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1446/2924] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:31:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:32:08.126992 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=50 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:34.064538 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:34.066050 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:34.078830 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991ff05-d79b-4a43-bfe3-29e9a774a6d9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:34.082403 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:34.083020 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:34.083301 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:34.083575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:34.085336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:34.173957 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:34.175336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddbf1f-65be-4e57-ba87-8fda70e2ea29 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:34.197262 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1479/2925] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:32:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:32:35.408483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:35.417844 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ad89-b033-4e58-b63a-83dff6f207c0 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:35.421532 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:35.422156 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:35.422434 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:35.422704 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:35.424462 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:35.438196 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:35.439782 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac806d-7ff8-43da-9794-1a3888293e1a service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:35.451577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1447/2926] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:32:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:32:44.194227 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=43 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:45.446000 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=6 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:55.131975 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfbb3e-0e7a-4865-a9d9-b7f632d74fe4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.132582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfbb3e-0e7a-4865-a9d9-b7f632d74fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.132771 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfbb3e-0e7a-4865-a9d9-b7f632d74fe4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.135157 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1480/2927] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:32:55.144114 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f0f1-4607-47a3-9c89-8b0276edc7e7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.144763 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f0f1-4607-47a3-9c89-8b0276edc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.145232 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88f0f1-4607-47a3-9c89-8b0276edc7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.189618 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bf88f0f1-4607-47a3-9c89-8b0276edc7e7 None None] MFA Rules not processed for user `c34d710cbc1e474aa98bf4e2c9cf9374`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:32:55.190855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bf88f0f1-4607-47a3-9c89-8b0276edc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:55.200358 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1448/2928] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:32:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:32:55.213421 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfbb3e-0e7a-4865-a9d9-b7f632d74fe4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:55.215513 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eccfbb3e-0e7a-4865-a9d9-b7f632d74fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:55.230740 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfbb3e-0e7a-4865-a9d9-b7f632d74fe4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:55.234515 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af9c96-168e-44ad-99a5-fa4d20d4eaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:55.235138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af9c96-168e-44ad-99a5-fa4d20d4eaca service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.235405 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af9c96-168e-44ad-99a5-fa4d20d4eaca service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.235681 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af9c96-168e-44ad-99a5-fa4d20d4eaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.247252 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af9c96-168e-44ad-99a5-fa4d20d4eaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:55.248775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af9c96-168e-44ad-99a5-fa4d20d4eaca service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:55.262875 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1481/2929] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:32:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:32:55.360230 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4218818-68bf-487d-9ace-c2209bd493d2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.360701 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4218818-68bf-487d-9ace-c2209bd493d2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.361198 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4218818-68bf-487d-9ace-c2209bd493d2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.363022 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1449/2930] 10.222.0.88 () {54 vars in 921 bytes} [Mon Aug 29 23:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:32:55.369424 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.369706 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.369988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.410008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] MFA Rules not processed for user `ece70bdb48004d8bb17968453f12a6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:32:55.411248 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:55.421615 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1482/2931] 10.222.0.88 () {58 vars in 1018 bytes} [Mon Aug 29 23:32:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:32:55.434868 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4218818-68bf-487d-9ace-c2209bd493d2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:55.446820 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4218818-68bf-487d-9ace-c2209bd493d2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:55.450492 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:55.451131 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.451409 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.451710 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.464985 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:55.466927 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:55.480843 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1450/2932] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:32:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:32:55.547876 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:55.549303 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:55.632518 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c206515-3d3f-46bc-8871-3c08224c7a21 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:55.638294 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:55.638907 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:55.639190 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:55.639459 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:55.641316 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:55.654415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:55.656415 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:55.669822 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1483/2933] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:32:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:32:57.191961 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:57.201943 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e971a-5842-48fd-a18d-9a403dad2d07 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:57.205697 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c34d710cbc1e474aa98bf4e2c9cf9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:57.206317 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:57.206590 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:57.206865 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:57.208630 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:57.219577 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:57.221011 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b366fbf-e5f7-45da-8141-b509bb9df10b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:57.230755 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1451/2934] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:32:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:05.663353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=47 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:07.225836 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=21 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:27.684214 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:27.687102 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:27.708030 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219dc9d-0ac5-4798-bf97-7e1bd95afc8f service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:27.717161 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ece70bdb48004d8bb17968453f12a6da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:27.718575 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:27.718881 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:27.719192 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:27.722189 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:27.739709 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:27.742613 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:27.760992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1484/2935] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:36.521036 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:36.521551 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:36.521655 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:36.574491 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] MFA Rules not processed for user `62c7982ed5014b4a8ff2ff3af660d4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:36.575735 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:36.642170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1452/2936] 10.222.0.88 () {58 vars in 967 bytes} [Mon Aug 29 23:33:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:36.683057 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:36.684527 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:36.776836 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04853e-e1c3-411e-aae6-94a05e84d172 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:36.781908 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a740dffa48ae44edb8f2a103bd8203c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:36.782596 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:36.782784 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:36.783056 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:36.791138 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:36.792698 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:36.800672 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1485/2937] 10.222.0.88 () {60 vars in 1384 bytes} [Mon Aug 29 23:33:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:33:43.725906 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:43.731279 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:43.809523 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902469c-8170-47a1-ad6d-0f246e82de07 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:43.814778 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:43.815437 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:43.815716 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:43.815993 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] PATH_INFO: `/v3/users/c02e09ee2f0849d2bab368a73d6f0b45` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:43.817134 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02e09ee2f0849d2bab368a73d6f0b45)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:43.819849 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:43.876042 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02e09ee2f0849d2bab368a73d6f0b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:43.876706 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02e09ee2f0849d2bab368a73d6f0b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:43.887381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02e09ee2f0849d2bab368a73d6f0b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:43.902233 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02e09ee2f0849d2bab368a73d6f0b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:43.903060 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02e09ee2f0849d2bab368a73d6f0b45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:43.905379 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:43.919839 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1453/2938] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:33:43 2022] DELETE /identity/v3/users/c02e09ee2f0849d2bab368a73d6f0b45 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:33:44.114720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:44.129213 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316e5b2-55df-42fa-86fc-fafcfb78adce service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:44.197625 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:44.198265 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:44.198550 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:44.198828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] PATH_INFO: `/v3/projects/8822d4549a7c40d790eebeef45d4a246` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:44.199967 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8822d4549a7c40d790eebeef45d4a246)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:44.201913 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:44.250918 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8822d4549a7c40d790eebeef45d4a246', 'request_id': 'req-3c7db579-14e4-4afb-a37c-2ec709584d04'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.257720 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8822d4549a7c40d790eebeef45d4a246', 'request_id': 'req-3c7db579-14e4-4afb-a37c-2ec709584d04'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.259624 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:44.266508 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8822d4549a7c40d790eebeef45d4a246', 'request_id': 'req-3c7db579-14e4-4afb-a37c-2ec709584d04'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.279250 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] The token cache is being invalidate because project 8822d4549a7c40d790eebeef45d4a246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:33:44.280203 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.280921 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.282542 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1486/2939] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:33:44 2022] DELETE /identity/v3/projects/8822d4549a7c40d790eebeef45d4a246 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:33:44.286757 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:44.288340 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:44.302293 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e2f7-af54-4cf5-aada-87ce06f9c546 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:44.364727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:44.365313 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:44.365807 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:44.366167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] PATH_INFO: `/v3/users/53ed844f34e04629af7e46003f40273a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:44.367383 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ed844f34e04629af7e46003f40273a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:44.369366 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:44.430736 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ed844f34e04629af7e46003f40273a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.431411 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ed844f34e04629af7e46003f40273a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.439237 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ed844f34e04629af7e46003f40273a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.451727 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ed844f34e04629af7e46003f40273a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.452439 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ed844f34e04629af7e46003f40273a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.465555 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1454/2940] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:33:44 2022] DELETE /identity/v3/users/53ed844f34e04629af7e46003f40273a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:33:44.657395 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:44.658932 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:44.673336 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db579-14e4-4afb-a37c-2ec709584d04 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:44.735207 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:44.735850 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:44.736139 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:44.736417 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] PATH_INFO: `/v3/projects/72e2ffb7edf248c48da21d6c71f953be` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:44.737582 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e2ffb7edf248c48da21d6c71f953be)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:44.739529 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:44.788526 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e2ffb7edf248c48da21d6c71f953be', 'request_id': 'req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.794828 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e2ffb7edf248c48da21d6c71f953be', 'request_id': 'req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.803629 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e2ffb7edf248c48da21d6c71f953be', 'request_id': 'req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.815775 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] The token cache is being invalidate because project 72e2ffb7edf248c48da21d6c71f953be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:33:44.816063 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.816724 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:33:44.818237 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1487/2941] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:33:44 2022] DELETE /identity/v3/projects/72e2ffb7edf248c48da21d6c71f953be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:33:54.461806 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:54.812555 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=55 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:37.840942 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:37.842500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:37.858500 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf1d22-9b25-468d-ab37-d93c62a800f9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:37.929819 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:37.930463 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:37.930746 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:37.931024 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] PATH_INFO: `/v3/users/a1949b6903e44c20adc2af0f3f858b43` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:37.932170 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1949b6903e44c20adc2af0f3f858b43)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:37.934144 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:37.983686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1949b6903e44c20adc2af0f3f858b43'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:37.984930 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1949b6903e44c20adc2af0f3f858b43'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:37.993480 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1949b6903e44c20adc2af0f3f858b43'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.006686 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1949b6903e44c20adc2af0f3f858b43'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.007413 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1949b6903e44c20adc2af0f3f858b43'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.020015 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1455/2942] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:34:37 2022] DELETE /identity/v3/users/a1949b6903e44c20adc2af0f3f858b43 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:34:38.189973 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:38.191512 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:38.207531 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa75cd-91e1-417a-b82f-9c9f90408ea1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:38.264832 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:38.265429 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:38.265713 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:38.265987 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] PATH_INFO: `/v3/projects/92430c091c8547389a0faf76628395c5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:38.267117 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92430c091c8547389a0faf76628395c5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:38.269581 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:38.317663 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92430c091c8547389a0faf76628395c5', 'request_id': 'req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.323092 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92430c091c8547389a0faf76628395c5', 'request_id': 'req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.329992 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92430c091c8547389a0faf76628395c5', 'request_id': 'req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.342298 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] The token cache is being invalidate because project 92430c091c8547389a0faf76628395c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:34:38.342614 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.343277 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.344826 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1488/2943] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:34:38 2022] DELETE /identity/v3/projects/92430c091c8547389a0faf76628395c5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:34:38.349483 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:38.350908 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:38.364474 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404d2e8-46e5-4136-8eb6-7f1efdc01339 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:38.422863 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:38.423488 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:38.423766 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:38.424039 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] PATH_INFO: `/v3/users/72c95043ea3c4d79925152b85cf43674` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:38.425167 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c95043ea3c4d79925152b85cf43674)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:38.427061 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:38.448041 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:38.475781 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c95043ea3c4d79925152b85cf43674'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.476438 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c95043ea3c4d79925152b85cf43674'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.483983 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c95043ea3c4d79925152b85cf43674'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.496486 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c95043ea3c4d79925152b85cf43674'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.497197 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c95043ea3c4d79925152b85cf43674'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.509944 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1456/2944] 10.222.0.88 () {58 vars in 1224 bytes} [Mon Aug 29 23:34:38 2022] DELETE /identity/v3/users/72c95043ea3c4d79925152b85cf43674 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:34:38.686809 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:38.688244 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:38.703281 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fc6c9-7ccf-4137-a1f8-24749b3b5a7a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:38.762088 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab308fcca9747a8a7a9f433ecd95299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0262c974ef34627ad89ce1c8f11f804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:38.762725 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:38.763008 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:38.763284 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] PATH_INFO: `/v3/projects/1ffd05cf20374303b04f0681eb13ac8c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:38.764404 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffd05cf20374303b04f0681eb13ac8c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:38.766353 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:38.801906 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:38.815633 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffd05cf20374303b04f0681eb13ac8c', 'request_id': 'req-08d4e7e1-b423-42c3-aebb-8dca2f54d265'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.821723 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffd05cf20374303b04f0681eb13ac8c', 'request_id': 'req-08d4e7e1-b423-42c3-aebb-8dca2f54d265'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.829160 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffd05cf20374303b04f0681eb13ac8c', 'request_id': 'req-08d4e7e1-b423-42c3-aebb-8dca2f54d265'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.840916 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] The token cache is being invalidate because project 1ffd05cf20374303b04f0681eb13ac8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:34:38.841240 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.841857 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08d4e7e1-b423-42c3-aebb-8dca2f54d265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:34:38.843319 dv-cinder-854272-4-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1489/2945] 10.222.0.88 () {58 vars in 1233 bytes} [Mon Aug 29 23:34:38 2022] DELETE /identity/v3/projects/1ffd05cf20374303b04f0681eb13ac8c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:34:48.506617 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:48.837988 dv-cinder-854272-4-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:44.520254 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:44.521723 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:44.602150 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05fe9d-cd2e-4086-a3ce-7ab76a151a13 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:44.663949 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7401c08c5de0437f8a605594dcce9395', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4baa30612c2847c997568c8533a3a554', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:44.664571 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:44.664855 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:44.665154 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:44.666915 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:44.678179 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:44.679762 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd3bc-820e-48a0-bac8-a8abbb7d33a9 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:44.690381 dv-cinder-854272-4-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1457/2946] 10.222.0.88 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:54.685652 dv-cinder-854272-4-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=58 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}